-- Logs begin at Fri 2022-06-03 08:58:30 UTC, end at Fri 2022-06-03 10:15:25 UTC. -- Jun 03 09:49:11.428986 dv-cinder-844563-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 03 09:49:11.436307 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 03 09:49:11.442370 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 3 09:49:11 2022] *** Jun 03 09:49:11.442370 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 03 09:49:11.442370 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 03 09:49:11.442370 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: nodename: dv-cinder-844563-1-iscsi Jun 03 09:49:11.442370 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: machine: x86_64 Jun 03 09:49:11.442370 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: clock source: unix Jun 03 09:49:11.442370 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: pcre jit disabled Jun 03 09:49:11.442370 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: detected number of CPU cores: 4 Jun 03 09:49:11.442370 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: current working directory: / Jun 03 09:49:11.442370 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: detected binary path: /usr/bin/uwsgi-core Jun 03 09:49:11.442370 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: your processes number limit is 47680 Jun 03 09:49:11.442370 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: your memory page size is 4096 bytes Jun 03 09:49:11.442370 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: detected max file descriptor number: 2048 Jun 03 09:49:11.442370 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: lock engine: pthread robust mutexes Jun 03 09:49:11.442370 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: thunder lock: enabled Jun 03 09:49:11.442370 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 03 09:49:11.442370 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 03 09:49:11.485746 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: Python main interpreter initialized at 0x5604973bc9c0 Jun 03 09:49:11.485746 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: python threads support enabled Jun 03 09:49:11.485746 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: your server socket listen backlog is limited to 100 connections Jun 03 09:49:11.485746 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: your mercy for graceful operations on workers is 90 seconds Jun 03 09:49:11.486107 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: mapped 403077 bytes (393 KB) for 2 cores Jun 03 09:49:11.486200 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: *** Operational MODE: preforking *** Jun 03 09:49:11.486440 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: *** uWSGI is running in multiple interpreter mode *** Jun 03 09:49:11.486440 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: spawned uWSGI master process (pid: 110273) Jun 03 09:49:11.486635 dv-cinder-844563-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 03 09:49:11.488018 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: spawned uWSGI worker 1 (pid: 110274, cores: 1) Jun 03 09:49:11.488018 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: spawned uWSGI worker 2 (pid: 110275, cores: 1) Jun 03 09:49:11.488018 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 03 09:49:12.692968 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 03 09:49:12.713554 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 03 09:49:13.401695 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 09:49:13.401695 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: from cryptography.utils import int_from_bytes Jun 03 09:49:13.402115 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 09:49:13.402115 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: from cryptography.utils import int_from_bytes Jun 03 09:49:13.407453 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 09:49:13.407453 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: from cryptography.utils import int_from_bytes Jun 03 09:49:13.407801 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 09:49:13.407801 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: from cryptography.utils import int_from_bytes Jun 03 09:49:15.985425 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 09:49:15.986147 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 09:49:15.986147 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 09:49:15.986482 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 09:49:15.986736 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 09:49:15.987121 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.987445 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.987757 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 09:49:15.988123 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.988206 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 09:49:15.988289 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.988373 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.988533 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 09:49:15.988681 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.988900 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 09:49:15.989016 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.989148 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 09:49:15.989302 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.989542 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.989655 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.989866 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.989988 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.990199 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.990294 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.990521 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-1-iscsi {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.990621 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.990839 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.990924 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.991143 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.991240 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.991449 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.991583 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.991763 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.991858 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.992065 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.992164 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.992337 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.992432 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.992653 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.992748 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.992988 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-1-iscsi {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.993150 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.993316 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.994482 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.994614 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.994694 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.994770 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.994851 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.994918 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.994992 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.995068 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.995144 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.995215 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.995291 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.995364 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.995435 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.995648 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.995809 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.995954 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.996107 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.996264 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.996382 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.996537 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.996672 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-1-iscsi {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.996878 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.997006 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.997193 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.997297 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.997503 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.997598 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.997826 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.997961 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.998242 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.998345 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.998547 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.998638 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.998892 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.998982 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.999217 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.999395 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-1-iscsi {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.999521 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.999617 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.999843 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:15.999937 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.000158 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.000251 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.000473 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.000598 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.000787 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.000916 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.001092 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.001236 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.001395 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.001559 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.001698 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.001911 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.002037 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.002218 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.002348 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.002549 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.002641 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.002878 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.002963 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.003179 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.003271 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.003497 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.003589 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.003800 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.003891 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.004114 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.004211 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.004361 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.004452 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.004609 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.004715 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.004922 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.005019 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.005237 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.005332 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.005541 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.005626 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.005844 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.005963 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.006172 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.006266 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.006474 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.006568 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.006776 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.006861 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.007058 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.007151 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.007314 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.007416 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.007636 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.007727 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.007953 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.008037 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.008261 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.008349 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.008570 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.008654 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.008871 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.009008 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.009180 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.009266 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.009490 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.009586 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.009801 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.009906 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.010137 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.010224 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.010449 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.010542 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.010768 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.010853 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.011073 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.011186 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.011389 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.011500 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.011695 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.011779 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.011998 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.012082 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.012305 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.012389 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.012607 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.012701 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.012920 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.013006 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.013239 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.013334 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.013541 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.013643 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.013789 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.013874 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.014112 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.014198 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.014414 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.015058 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.015282 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.015372 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.015586 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.015673 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.015890 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.015986 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.016190 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.016276 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.016486 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.016579 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.016787 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.016873 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.017088 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.017177 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.017388 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.017473 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.017690 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.017779 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.018018 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.018117 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.018320 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.018405 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.018621 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.018718 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.018921 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.019006 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.019219 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.019313 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.019530 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.019652 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.019845 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.019930 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.020146 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.020247 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.020448 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.020541 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.020748 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.020842 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.021049 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.021143 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.021355 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.021495 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.021653 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.021737 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.021977 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.022086 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.022298 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.022384 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.022600 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.022685 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.022901 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.022994 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.023215 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.023307 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.023516 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.023602 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.023816 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.023913 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.024129 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.024222 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.024428 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.024520 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.024731 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.024824 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.025041 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.025127 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.025344 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.025431 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.025644 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.026091 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.026231 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.026317 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.026531 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.026617 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.026831 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.026928 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.027131 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.027217 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.027430 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.027516 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.027729 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.027821 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.028025 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.028110 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.028337 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.028423 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.028642 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.028727 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.028946 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.029030 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.029248 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.029334 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.029549 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.029635 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.029854 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.029987 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.030743 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.030852 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.031043 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.031130 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.031348 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.031475 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.031670 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.031790 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.031996 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.032119 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.032309 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.032454 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.032620 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.032769 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.032935 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.033079 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.033259 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:49:16.033391 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.033595 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.033716 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.033963 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.034051 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.034312 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.034397 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.034633 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.034732 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.034948 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.035033 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.035261 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.035399 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.035588 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.035679 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.035901 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.035989 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.036214 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.036306 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.036528 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.036614 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.036836 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.036935 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.037148 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.037233 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.037463 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.037560 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.037778 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.037868 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.038111 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.038208 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.038444 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.038540 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.038767 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.038860 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.039076 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.039161 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.039395 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.039482 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.039708 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.039793 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.040018 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.040102 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.040328 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.040414 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.040636 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.040721 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.040953 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.041047 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.041281 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.041368 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.041591 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.041720 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.041923 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.042025 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.042239 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.042325 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.042553 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.042638 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.042861 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.042955 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.043170 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.043256 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.043477 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.043562 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.043807 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.043938 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.044117 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.044278 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.044429 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.044598 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.044736 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.044924 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.045046 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.045244 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.045352 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.045563 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.045660 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.045922 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.046013 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.046243 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.046329 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.046559 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.046657 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.046869 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.046953 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.047175 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.047267 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.047476 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.047570 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.047792 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.047885 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.048112 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.048198 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.048413 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.048507 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.048725 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.048810 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.049031 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.049122 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.049337 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.049464 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.049641 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.049727 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.049970 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.050057 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.050282 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.050375 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.050590 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.050674 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.050896 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.050983 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.051200 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.051287 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.051519 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.051605 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.051825 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.051910 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.052130 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.052223 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.052448 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.052532 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.052748 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.052845 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.053051 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.053138 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.053361 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.053445 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.053665 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.053758 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.053995 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.054093 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.054304 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.054397 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.054608 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.054703 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.054923 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.055055 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.055232 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.055324 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.055537 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.055634 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.055856 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.055941 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.056168 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.056261 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.056468 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.056553 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.056787 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.056880 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.057100 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.057196 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.057413 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.057499 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.057715 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.057801 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.058046 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.058134 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.058349 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.058436 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.058650 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.058743 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.058952 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.059037 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.059257 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.059344 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.059557 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.059643 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.059858 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.059956 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.060156 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.060248 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.060455 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.060540 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.060756 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.060850 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.061072 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.061170 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.061397 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.061482 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.061702 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.061795 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.062026 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.062123 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.062328 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.062421 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.062654 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.062751 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.062957 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.063041 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.063262 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.063355 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.063571 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.063665 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.063880 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.063967 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.064204 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.064290 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.064509 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.064600 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.064815 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.064899 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.065117 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.065209 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.065422 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.065508 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.065724 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.065815 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.066052 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.066141 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.066368 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.066455 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.066673 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.066760 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.066987 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.067081 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.067292 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.067378 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.067609 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.067701 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.067915 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.068010 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.068229 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.068321 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.068529 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.068614 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.068837 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.068930 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.069152 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.069237 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.069474 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.069560 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.069786 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.069926 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.070485 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.070589 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.070669 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.070747 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.070825 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.070923 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.071005 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.071084 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.071315 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.071410 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.071619 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.071706 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.071923 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.072064 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.072235 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.072323 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.072545 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.072639 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.072856 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.072951 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.073161 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.073246 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.073477 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.073571 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.073782 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.073867 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.074116 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.074202 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.074418 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.074506 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.074725 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.074810 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.075042 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.075134 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.075364 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.075450 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.075667 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.075790 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.075975 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.076069 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.076284 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.076369 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.076589 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.076674 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.076894 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.077495 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.077733 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.077819 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.078060 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.078157 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.078363 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.078525 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.078667 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.078753 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.078974 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.079060 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.079279 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.079405 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.079583 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.079728 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.079884 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.080053 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.080193 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.080370 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.080498 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.080686 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.080779 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.081003 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.081101 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.081312 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.081397 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.081621 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.081706 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.081976 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.082115 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.082297 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.082391 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.082611 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.082699 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.082925 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.083018 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.083234 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.083327 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.083548 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.083633 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.083855 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.083949 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.084156 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.084241 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.084458 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.084543 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.084758 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.084852 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.085082 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.085166 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.085384 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.085475 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.085682 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.085768 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.086018 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.086109 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.086336 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.086422 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.086641 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.086735 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.086949 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.087042 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.087252 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.087345 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.087555 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.087641 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.087861 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.087952 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.088169 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.088260 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.088473 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.088558 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.088777 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.088863 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.089083 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.089176 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.089386 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.089472 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.089689 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.089774 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.090030 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.090137 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.090335 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.090466 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.090640 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.090735 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.090944 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.091031 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.091243 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.091335 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.091546 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.091632 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.091857 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.091944 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.092169 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.092417 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.092504 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.093396 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.093507 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.093673 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.093760 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.094062 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.094154 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.094380 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.094477 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.094696 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.094783 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.095011 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.095098 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.095320 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.095414 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.095634 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.095721 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.095957 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.096055 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.096265 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.096519 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.096615 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.096854 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.096941 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.097161 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.097245 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.097464 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.097558 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.097766 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.097852 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.098094 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.098193 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.098401 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.098495 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.098701 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.098794 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.099003 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.099090 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.099302 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.099408 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.099604 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.099690 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.099913 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.100005 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.100213 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.100311 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.100520 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.100606 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.100819 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.100903 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.101138 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.101232 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.101443 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.101528 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.101742 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.101834 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.102068 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.102164 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.102369 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.102460 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.102673 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.102757 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.102983 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.103078 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.103301 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.103387 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.103613 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.103698 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.103929 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.104015 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.104233 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.104327 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.104534 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.104626 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.104856 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.104943 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.105160 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.105257 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.105463 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.105557 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.105766 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.105851 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.106106 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.106191 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.106412 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.106506 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.106712 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.106805 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.107018 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.107110 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.107321 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.107415 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.107627 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.107713 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.107931 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.108024 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.108250 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.108340 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.108555 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.108642 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.108856 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.108941 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.109164 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.109251 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.109469 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.109555 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.109769 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.109861 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.110093 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.110181 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.110399 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.110485 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.110700 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.110786 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.111000 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.111086 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.111304 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.111390 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.111601 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.111696 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.111913 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.111999 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.112215 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.112300 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.112514 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.112607 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.112812 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.112899 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.113118 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.113203 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.113426 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.113519 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.113724 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.113816 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.114055 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.114142 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.114363 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.114458 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.114668 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.114753 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.114969 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.115054 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.115286 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.115372 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.115594 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.115686 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.115893 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.115983 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.116198 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.116290 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.116510 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.116602 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.116820 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.116906 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.117116 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.117200 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.117422 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.117515 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.117721 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.117816 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.118045 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.118134 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.118347 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.118433 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.118649 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.118746 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.118949 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.119035 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.119247 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.119332 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.119545 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.119639 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.119844 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.119936 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.120143 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.120228 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.120458 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.120552 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.120761 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.120854 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.121060 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.121152 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.121360 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.121454 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.121658 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.121744 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.121988 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.122080 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.122293 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.122380 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.122598 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.122684 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.122906 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.123034 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.123214 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.123302 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.123523 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.123609 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.123850 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.123937 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.124159 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.124253 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.124465 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.124551 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.124763 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.124849 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.125068 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.125159 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.125370 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.125455 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.126002 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.126127 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.126268 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.126352 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.126431 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.126515 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.126603 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.126691 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.126871 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.126957 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.127176 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.127269 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.127490 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.127588 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.127808 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.127895 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.128126 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.128211 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.128427 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.128520 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.128730 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.128817 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.129036 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.129129 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.129341 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.129434 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.129643 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.129726 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.129968 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.130066 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.130276 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.130363 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.130583 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.130668 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.130888 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.130983 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.131194 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.131282 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.131497 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.131582 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.131798 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.131882 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.132101 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.132188 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.132404 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.132490 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.132706 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.132798 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.133015 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.133100 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.133321 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.133412 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.133620 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.133714 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.133950 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.134036 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.134252 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.134336 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.134558 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.134654 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.134858 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.134944 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.135164 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.135279 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.135474 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.135572 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.135784 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.135870 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.136093 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.136177 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.136418 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.136511 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.136729 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.136814 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.137035 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.137121 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.137341 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.137426 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.137640 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.137727 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.137978 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.138065 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.138289 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.138376 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.138662 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.138746 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.138967 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.139060 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.139267 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.139353 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.140102 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.140206 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.140411 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.140505 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.140729 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.140816 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.141031 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.141117 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.141331 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.141425 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.141631 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.141716 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.141969 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.142080 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.142271 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.142397 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.142588 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.142711 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.142997 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.143082 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.143301 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.143400 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.143603 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.143689 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.143921 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.144004 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.144247 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.144348 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.144554 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.144647 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.144862 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.144947 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.145167 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.145253 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.145492 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.145584 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.145789 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.145873 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.146121 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.146211 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.146424 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.146563 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.146743 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.146831 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.147062 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.147148 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.147368 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.147532 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.147676 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.147847 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.147975 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.148161 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.148291 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.148486 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.148606 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.148811 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.148903 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.149136 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.149230 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.149443 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.149611 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.149757 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.149949 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.150092 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.150255 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.150421 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.150553 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.151010 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.151135 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.151323 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.151437 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.151640 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.151733 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.151950 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.152036 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.152276 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.152363 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.152598 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.152683 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.152912 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.153003 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.153212 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.153297 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.153520 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.153640 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.153831 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.154011 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.154160 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.154326 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.154457 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.154650 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.154737 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.154977 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.155115 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.155341 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.155428 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.155650 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.155735 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.155963 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.156051 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.156271 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.156357 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.156580 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.156666 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.156879 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.156965 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.157197 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.157284 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.157503 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.157598 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.157804 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.157953 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.158131 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.158217 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.158432 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.158535 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.158737 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.158822 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.159058 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.159143 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.159364 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.159457 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.159685 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.159770 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.160002 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.160087 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.160307 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.160401 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.160635 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.160721 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.160942 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.161027 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.161259 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.161378 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.161569 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.161669 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.161876 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.162009 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.162199 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.162296 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.162499 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.162597 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.162802 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.162916 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.163101 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.163198 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.163399 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.163497 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.163698 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.163802 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.164005 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.164101 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.164301 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.164399 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.164597 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.164702 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.164894 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.165025 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.165208 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.165346 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.165507 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.165668 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.165823 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.166018 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.166168 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.166330 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.166471 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.166642 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.166778 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.166957 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.167078 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.167264 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.167414 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.167572 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.167710 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.167879 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.168038 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.168191 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.168349 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.168495 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.168666 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.168799 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.168987 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.169104 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.169290 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.169428 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.169607 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.169734 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.169935 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.170081 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.170247 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.170394 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.170557 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.171219 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.171402 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.171542 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.171693 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.171848 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.172009 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.172191 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.172318 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.172497 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.172620 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.172836 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.172953 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.173158 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.173257 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.173483 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.173580 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.173813 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.174060 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.174158 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.174390 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.174502 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.174700 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.174796 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.175010 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.175116 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.175319 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.175424 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.175629 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.175725 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.175937 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.176034 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.176244 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.176341 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.176550 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.176648 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.176856 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.176953 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.177160 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.177257 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.177483 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.177591 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.177799 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.177922 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.178206 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.178347 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.178538 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.178681 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.178849 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.179009 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.179160 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.179304 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.179470 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.179621 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.179779 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.179938 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.180126 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.180341 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.180427 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.180664 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.180751 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.180980 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.181067 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.181293 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.181380 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.181603 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.181708 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.181924 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.182015 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.182233 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.182319 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.182540 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.182640 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.182847 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.182933 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.183157 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.183265 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.183461 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.183569 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.183766 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.183863 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.184073 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.184170 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.184396 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.184501 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.184723 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.184821 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.185036 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.185133 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.185343 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.185439 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.185650 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.185760 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.185989 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.186177 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.186355 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.186570 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.186668 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.186864 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.186962 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.187193 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.187290 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.187514 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.187618 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.187832 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.187928 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.188142 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.188238 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.188455 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.188558 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.188778 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.188884 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.189080 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.189176 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.189383 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.189479 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.189689 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.189795 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.190017 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.190115 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.190319 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.190415 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.190637 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.190859 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.190969 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.191179 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.191273 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.191517 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.191616 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.191824 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.191921 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.192159 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.192347 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.192478 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.192690 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.192798 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.193003 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.193128 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.193326 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.193423 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.193646 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.193733 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.193983 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.194089 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.194295 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.194389 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.194614 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.194701 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.194917 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.195010 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.195218 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.195310 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.195528 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.195622 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.195832 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.195918 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.196132 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.196230 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.196432 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.196688 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.196774 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.197027 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.197111 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.197326 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.197413 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.197632 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.197725 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.197950 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.198038 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.198276 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.198370 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.198578 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.198664 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.198879 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.198965 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.199182 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.199277 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.199489 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.199575 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.199789 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.199883 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.200090 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.200176 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.200393 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.200479 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.200692 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.200790 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.200999 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.201085 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.201300 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.201387 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.201604 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.201698 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.201923 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.202554 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.202762 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.202849 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.203063 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.203163 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.203371 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.203497 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.203684 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.203781 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.203993 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.204091 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.204308 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.204404 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.204606 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.204708 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.204916 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.205011 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.205221 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.205317 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.205524 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.205619 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.205834 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.205942 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.206164 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.206259 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.206477 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.206574 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.206786 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.206895 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.207098 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.207319 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.207416 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.207649 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.207753 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.207965 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.208062 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.208294 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.208390 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.208621 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.208718 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.208927 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.209023 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.209231 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.209335 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.209531 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.209628 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.209850 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.209986 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.210183 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.210287 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.210490 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.210595 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.210796 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.210892 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.211105 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.211218 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.211400 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.211729 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.211888 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.212045 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.212191 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.212348 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.212503 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.212658 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.212812 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.212967 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.213114 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.213268 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.213426 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.213572 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.213716 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.213863 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.214058 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.214215 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.214362 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.214509 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.214654 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.214800 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.214959 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.215107 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.215264 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.215421 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.215574 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.215721 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.215940 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.216098 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.216253 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.216401 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.216554 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.216710 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.216866 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.217050 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.217199 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.217357 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.217503 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.217713 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.217871 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.218044 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.218192 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.218348 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.218494 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.218652 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.218800 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.218947 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.219092 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.219257 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.219413 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.219560 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.219705 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.219857 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.220003 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.220150 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.220327 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.220479 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.220635 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.220781 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.220926 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.221081 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.221329 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.221483 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.221629 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.221792 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.221975 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.222126 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.222281 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.222430 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.222575 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.222729 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.222875 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.223029 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.223186 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.223333 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.223486 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.223632 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.223778 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.223932 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.224086 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.224232 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.224385 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.224539 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.224698 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.224853 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.224853 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.225160 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.225313 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.225472 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.225632 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.225779 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.225953 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.226106 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.226261 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.226414 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.226574 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.226729 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.226875 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.227031 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.227177 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.227321 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.227476 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.227623 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.227768 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.227914 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.228066 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.228213 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.228366 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.228513 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.228668 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.228824 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.228970 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.229128 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.229274 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.229419 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.229565 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.229717 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.229863 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.230078 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.230228 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.230228 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.230505 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.230505 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.230812 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.231002 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.231154 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.231318 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.231534 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.231714 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.231883 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.232031 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.232177 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.232321 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.232467 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.232620 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.232780 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.232938 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.233085 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.233748 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.233920 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.234074 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.234233 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.234381 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.234527 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.234673 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.234825 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.234973 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.235127 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.235275 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.235472 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.235629 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.235782 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.235959 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.236178 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.236355 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.236511 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.236658 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.236803 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.236959 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.237113 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.237260 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.237443 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.237605 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.237752 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.237962 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.238118 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.238276 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.238422 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.238568 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.238722 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.238878 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.239026 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.239178 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.239325 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.239482 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.239641 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.239641 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.239919 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.240065 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.240210 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.240362 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.240517 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.240664 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.240809 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.240967 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.241113 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.241270 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.241425 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.241657 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.241810 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.241986 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.242134 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.242294 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.242441 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.242587 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.242732 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.242885 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.243040 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.243040 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.243342 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.243489 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.243635 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.243781 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.243927 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.244082 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.244230 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.244378 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.244523 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.244667 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.244890 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.245040 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.245197 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.245345 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.245490 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.245490 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 09:49:16.245788 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.245788 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.245788 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.245788 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.245788 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.246512 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.246512 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.246802 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.247054 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.247406 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.247723 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.248068 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.248401 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.248719 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.249591 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.249924 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:49:16.250177 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 09:49:16.302457 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO dbcounter [None req-6d5d93c7-72a1-48fa-99ca-43a3c6071a15 None None] Registered counter for database nova_api Jun 03 09:49:16.308326 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO dbcounter [None req-c48b801b-c21b-47f5-9f4b-22f870ef0c6d None None] Registered counter for database nova_api Jun 03 09:49:16.324148 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG oslo_db.sqlalchemy.engines [None req-6d5d93c7-72a1-48fa-99ca-43a3c6071a15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110275) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:49:16.327995 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG oslo_db.sqlalchemy.engines [None req-c48b801b-c21b-47f5-9f4b-22f870ef0c6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:49:16.331433 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG dbcounter [-] [110275] Writer thread running {{(pid=110275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:49:16.335330 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG dbcounter [-] [110274] Writer thread running {{(pid=110274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:49:16.386893 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.context [None req-6d5d93c7-72a1-48fa-99ca-43a3c6071a15 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),17431b75-2fed-4946-b465-0bb5f71f4e56(cell1) {{(pid=110275) load_cells /opt/stack/nova/nova/context.py:464}} Jun 03 09:49:16.391042 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG oslo_concurrency.lockutils [None req-6d5d93c7-72a1-48fa-99ca-43a3c6071a15 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:49:16.391442 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.context [None req-c48b801b-c21b-47f5-9f4b-22f870ef0c6d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),17431b75-2fed-4946-b465-0bb5f71f4e56(cell1) {{(pid=110274) load_cells /opt/stack/nova/nova/context.py:464}} Jun 03 09:49:16.392616 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG oslo_concurrency.lockutils [None req-6d5d93c7-72a1-48fa-99ca-43a3c6071a15 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:49:16.393400 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG oslo_concurrency.lockutils [None req-6d5d93c7-72a1-48fa-99ca-43a3c6071a15 None None] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:49:16.395371 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG oslo_concurrency.lockutils [None req-6d5d93c7-72a1-48fa-99ca-43a3c6071a15 None None] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:49:16.395570 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG oslo_concurrency.lockutils [None req-c48b801b-c21b-47f5-9f4b-22f870ef0c6d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:49:16.397146 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG oslo_concurrency.lockutils [None req-c48b801b-c21b-47f5-9f4b-22f870ef0c6d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:49:16.397312 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO dbcounter [None req-6d5d93c7-72a1-48fa-99ca-43a3c6071a15 None None] Registered counter for database nova_cell0 Jun 03 09:49:16.397971 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG oslo_concurrency.lockutils [None req-c48b801b-c21b-47f5-9f4b-22f870ef0c6d None None] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:49:16.399929 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG oslo_concurrency.lockutils [None req-c48b801b-c21b-47f5-9f4b-22f870ef0c6d None None] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:49:16.401552 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO dbcounter [None req-6d5d93c7-72a1-48fa-99ca-43a3c6071a15 None None] Registered counter for database nova_cell1 Jun 03 09:49:16.402152 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO dbcounter [None req-c48b801b-c21b-47f5-9f4b-22f870ef0c6d None None] Registered counter for database nova_cell0 Jun 03 09:49:16.406656 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO dbcounter [None req-c48b801b-c21b-47f5-9f4b-22f870ef0c6d None None] Registered counter for database nova_cell1 Jun 03 09:49:16.409277 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG oslo_db.sqlalchemy.engines [None req-6d5d93c7-72a1-48fa-99ca-43a3c6071a15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110275) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:49:16.411633 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG oslo_db.sqlalchemy.engines [None req-6d5d93c7-72a1-48fa-99ca-43a3c6071a15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110275) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:49:16.413732 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG oslo_db.sqlalchemy.engines [None req-c48b801b-c21b-47f5-9f4b-22f870ef0c6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:49:16.414973 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG oslo_db.sqlalchemy.engines [None req-c48b801b-c21b-47f5-9f4b-22f870ef0c6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:49:16.417565 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG dbcounter [-] [110275] Writer thread running {{(pid=110275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:49:16.419552 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG dbcounter [-] [110275] Writer thread running {{(pid=110275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:49:16.422609 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG dbcounter [-] [110274] Writer thread running {{(pid=110274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:49:16.423901 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG dbcounter [-] [110274] Writer thread running {{(pid=110274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:49:16.562420 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO dbcounter [None req-6d5d93c7-72a1-48fa-99ca-43a3c6071a15 None None] Registered counter for database nova_cell0 Jun 03 09:49:16.568052 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO dbcounter [None req-c48b801b-c21b-47f5-9f4b-22f870ef0c6d None None] Registered counter for database nova_cell0 Jun 03 09:49:16.571077 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG oslo_db.sqlalchemy.engines [None req-6d5d93c7-72a1-48fa-99ca-43a3c6071a15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110275) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:49:16.575447 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG dbcounter [-] [110275] Writer thread running {{(pid=110275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:49:16.576775 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG oslo_db.sqlalchemy.engines [None req-c48b801b-c21b-47f5-9f4b-22f870ef0c6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:49:16.581805 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG dbcounter [-] [110274] Writer thread running {{(pid=110274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:49:17.105702 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: WARNING keystonemiddleware.auth_token [None req-6d5d93c7-72a1-48fa-99ca-43a3c6071a15 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 09:49:17.113106 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: WARNING keystonemiddleware.auth_token [None req-6d5d93c7-72a1-48fa-99ca-43a3c6071a15 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 09:49:17.113214 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: WARNING keystonemiddleware.auth_token [None req-c48b801b-c21b-47f5-9f4b-22f870ef0c6d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 09:49:17.120408 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: WARNING keystonemiddleware.auth_token [None req-c48b801b-c21b-47f5-9f4b-22f870ef0c6d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 09:49:17.339394 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: WARNING keystonemiddleware.auth_token [None req-6d5d93c7-72a1-48fa-99ca-43a3c6071a15 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 09:49:17.342987 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: WARNING keystonemiddleware.auth_token [None req-c48b801b-c21b-47f5-9f4b-22f870ef0c6d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 09:49:17.345357 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: WARNING keystonemiddleware.auth_token [None req-6d5d93c7-72a1-48fa-99ca-43a3c6071a15 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 09:49:17.348837 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: WARNING keystonemiddleware.auth_token [None req-c48b801b-c21b-47f5-9f4b-22f870ef0c6d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 09:49:17.350503 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5604973bc9c0 pid: 110275 (default app) Jun 03 09:49:17.352842 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-6d5d93c7-72a1-48fa-99ca-43a3c6071a15 None None] Calling method '>' {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:49:17.353905 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5604973bc9c0 pid: 110274 (default app) Jun 03 09:49:17.354096 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-6d5d93c7-72a1-48fa-99ca-43a3c6071a15 None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001975 Jun 03 09:49:17.354512 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Fri Jun 3 09:49:17 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:50:38.053512 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-c48b801b-c21b-47f5-9f4b-22f870ef0c6d None None] Calling method '>' {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:38.054791 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-c48b801b-c21b-47f5-9f4b-22f870ef0c6d None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002310 Jun 03 09:50:38.055657 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jun 3 09:50:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:50:38.067905 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG dbcounter [-] [110275] Writing DB stats nova_api:SELECT=3 {{(pid=110275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:50:38.069030 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG dbcounter [-] [110275] Writing DB stats nova_cell0:SELECT=3 {{(pid=110275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:50:38.069863 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG dbcounter [-] [110275] Writing DB stats nova_cell1:SELECT=3 {{(pid=110275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:50:38.070719 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG dbcounter [-] [110275] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:50:38.524595 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-f7c7ec45-78e6-4664-8da1-3037d91cbaba admin admin] Calling method '>' {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:38.555895 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-f7c7ec45-78e6-4664-8da1-3037d91cbaba admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.493899 Jun 03 09:50:38.556774 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 2/3] 10.222.0.42 () {60 vars in 1291 bytes} [Fri Jun 3 09:50:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:50:40.830673 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-c48b801b-c21b-47f5-9f4b-22f870ef0c6d None None] Calling method '>' {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:40.831683 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-c48b801b-c21b-47f5-9f4b-22f870ef0c6d None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jun 03 09:50:40.832066 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 2/4] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jun 3 09:50:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:50:40.897173 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-dac5651f-514a-4138-bcab-09c79a68de44 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "cirros256", "swap": 0, "rxtx_factor": 1.0, "disk": 1, "ram": 256, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:50:40.916045 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:50:40.916045 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: warnings.warn(msg) Jun 03 09:50:41.003136 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-dac5651f-514a-4138-bcab-09c79a68de44 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.164774 Jun 03 09:50:41.003789 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 3/5] 10.222.0.42 () {64 vars in 1282 bytes} [Fri Jun 3 09:50:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:50:41.017659 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG dbcounter [-] [110274] Writing DB stats nova_api:SELECT=3 {{(pid=110274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:50:41.018888 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG dbcounter [-] [110274] Writing DB stats nova_cell1:SELECT=3 {{(pid=110274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:50:41.019617 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG dbcounter [-] [110274] Writing DB stats nova_cell0:SELECT=3 {{(pid=110274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:50:41.020539 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG dbcounter [-] [110274] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:50:41.228226 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-0dd83392-1ded-4f0f-8ad1-890a59d2e9f5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:50:41.230714 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:50:41.230714 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: warnings.warn(msg) Jun 03 09:50:41.348989 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-0dd83392-1ded-4f0f-8ad1-890a59d2e9f5 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.336531 Jun 03 09:50:41.349944 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 3/6] 10.222.0.42 () {64 vars in 1335 bytes} [Fri Jun 3 09:50:41 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:50:43.637531 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-dac5651f-514a-4138-bcab-09c79a68de44 admin admin] Calling method '>' {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:43.638603 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-dac5651f-514a-4138-bcab-09c79a68de44 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Jun 03 09:50:43.639188 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 4/7] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jun 3 09:50:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:50:43.745827 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-4a4629a3-2e22-46b5-a7fb-290f846c8653 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "os-flavor-access:is_public": true, "id": "d1", "swap": 0, "name": "ds512M", "disk": 5, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:50:43.763478 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:50:43.763478 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: warnings.warn(msg) Jun 03 09:50:43.891921 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-4a4629a3-2e22-46b5-a7fb-290f846c8653 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.246528 Jun 03 09:50:43.892518 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 4/8] 10.222.0.42 () {64 vars in 1282 bytes} [Fri Jun 3 09:50:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:50:43.905362 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-1a4d1cde-15d5-45d2-83b0-4cee77e30578 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:50:43.906852 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:50:43.906852 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: warnings.warn(msg) Jun 03 09:50:44.010635 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-1a4d1cde-15d5-45d2-83b0-4cee77e30578 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109640 Jun 03 09:50:44.013957 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 5/9] 10.222.0.42 () {64 vars in 1335 bytes} [Fri Jun 3 09:50:43 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:50:46.318267 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-4a4629a3-2e22-46b5-a7fb-290f846c8653 admin admin] Calling method '>' {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:46.319300 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-4a4629a3-2e22-46b5-a7fb-290f846c8653 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001657 Jun 03 09:50:46.320030 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jun 3 09:50:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:50:46.382606 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-5ced107f-72bd-4608-bd84-4d428216487a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d2", "ram": 1024, "name": "ds1G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:50:46.509113 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-5ced107f-72bd-4608-bd84-4d428216487a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.182650 Jun 03 09:50:46.509870 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 6/11] 10.222.0.42 () {64 vars in 1282 bytes} [Fri Jun 3 09:50:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:50:46.522532 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-bc8fb2ec-5c2a-44c3-89ae-a509b6127dff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:50:46.729550 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-bc8fb2ec-5c2a-44c3-89ae-a509b6127dff admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.210924 Jun 03 09:50:46.733226 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 6/12] 10.222.0.42 () {64 vars in 1335 bytes} [Fri Jun 3 09:50:46 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:50:49.017946 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-5ced107f-72bd-4608-bd84-4d428216487a admin admin] Calling method '>' {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:49.019054 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-5ced107f-72bd-4608-bd84-4d428216487a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001628 Jun 03 09:50:49.019459 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 7/13] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jun 3 09:50:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:50:49.078579 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-abd19de0-4ccf-4fc4-90dc-3054ca70914b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "vcpus": 2, "name": "ds2G", "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:50:49.171488 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-abd19de0-4ccf-4fc4-90dc-3054ca70914b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.145644 Jun 03 09:50:49.172042 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 7/14] 10.222.0.42 () {64 vars in 1282 bytes} [Fri Jun 3 09:50:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:50:49.183937 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-5876c5e7-aecc-4659-a0de-73c93871c466 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:50:49.271853 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-5876c5e7-aecc-4659-a0de-73c93871c466 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091636 Jun 03 09:50:49.272436 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 8/15] 10.222.0.42 () {64 vars in 1335 bytes} [Fri Jun 3 09:50:49 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:50:51.532550 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-abd19de0-4ccf-4fc4-90dc-3054ca70914b admin admin] Calling method '>' {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:51.533555 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-abd19de0-4ccf-4fc4-90dc-3054ca70914b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jun 03 09:50:51.534202 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 8/16] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jun 3 09:50:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:50:51.595357 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-c906a783-a3da-47fa-afd5-ce3214a74803 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "rxtx_factor": 1.0, "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "os-flavor-access:is_public": true, "disk": 20, "vcpus": 4}} {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:50:51.666992 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-c906a783-a3da-47fa-afd5-ce3214a74803 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.126924 Jun 03 09:50:51.667827 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 9/17] 10.222.0.42 () {64 vars in 1282 bytes} [Fri Jun 3 09:50:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 09:50:51.679257 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-7977ea11-d3f9-4fd0-9e42-06718383208f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:50:51.763814 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-7977ea11-d3f9-4fd0-9e42-06718383208f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088046 Jun 03 09:50:51.764444 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 9/18] 10.222.0.42 () {64 vars in 1335 bytes} [Fri Jun 3 09:50:51 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:50:54.080925 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-c906a783-a3da-47fa-afd5-ce3214a74803 admin admin] Calling method '>' {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:54.081978 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-c906a783-a3da-47fa-afd5-ce3214a74803 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jun 03 09:50:54.082632 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 10/19] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jun 3 09:50:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:50:54.146315 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-73ae40d7-7b63-4694-8c85-80ac77c9b751 admin admin] Calling method '>' {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:54.175513 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-73ae40d7-7b63-4694-8c85-80ac77c9b751 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.086787 Jun 03 09:50:54.176377 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 10/20] 10.222.0.42 () {60 vars in 1291 bytes} [Fri Jun 3 09:50:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:50:56.450673 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-c906a783-a3da-47fa-afd5-ce3214a74803 admin admin] Calling method '>' {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:56.451695 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-c906a783-a3da-47fa-afd5-ce3214a74803 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Jun 03 09:50:56.452099 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 11/21] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jun 3 09:50:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:50:56.513410 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-9796d934-3acd-4dc4-a576-2bb1114b7f91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "vcpus": 1, "disk": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "1"}} {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:50:56.633622 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-9796d934-3acd-4dc4-a576-2bb1114b7f91 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.175467 Jun 03 09:50:56.634149 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 11/22] 10.222.0.42 () {64 vars in 1282 bytes} [Fri Jun 3 09:50:56 2022] POST /compute/v2.1/flavors => generated 402 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 09:50:56.646866 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-933ac852-b955-4f69-bd93-a91f44acdf5e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:50:56.717789 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-933ac852-b955-4f69-bd93-a91f44acdf5e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074699 Jun 03 09:50:56.718405 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 12/23] 10.222.0.42 () {64 vars in 1332 bytes} [Fri Jun 3 09:50:56 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:50:59.291234 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-9796d934-3acd-4dc4-a576-2bb1114b7f91 admin admin] Calling method '>' {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:59.293385 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-9796d934-3acd-4dc4-a576-2bb1114b7f91 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002574 Jun 03 09:50:59.293782 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 12/24] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jun 3 09:50:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:50:59.363844 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-b7a00a31-b447-4f53-b2f9-8a662d7c27e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "name": "m1.small", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "id": "2"}} {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:50:59.433330 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-b7a00a31-b447-4f53-b2f9-8a662d7c27e8 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.132965 Jun 03 09:50:59.433901 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 13/25] 10.222.0.42 () {64 vars in 1282 bytes} [Fri Jun 3 09:50:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:50:59.445857 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-70297f7b-847a-43b9-a44f-c13c33c9794d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:50:59.499907 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-70297f7b-847a-43b9-a44f-c13c33c9794d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.057495 Jun 03 09:50:59.500359 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 13/26] 10.222.0.42 () {64 vars in 1332 bytes} [Fri Jun 3 09:50:59 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:51:01.800621 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-b7a00a31-b447-4f53-b2f9-8a662d7c27e8 admin admin] Calling method '>' {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:51:01.801639 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-b7a00a31-b447-4f53-b2f9-8a662d7c27e8 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jun 03 09:51:01.802082 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 14/27] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jun 3 09:51:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:51:01.860658 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-9f161246-1b05-407d-9135-c5dd1045dfe0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "3", "vcpus": 2, "name": "m1.medium", "ram": 4096, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:51:01.925712 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-9f161246-1b05-407d-9135-c5dd1045dfe0 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.117142 Jun 03 09:51:01.926501 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 14/28] 10.222.0.42 () {64 vars in 1282 bytes} [Fri Jun 3 09:51:01 2022] POST /compute/v2.1/flavors => generated 406 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:51:01.938886 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-c5e3dc35-3c66-458c-a7bf-8a83140e2b13 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:51:02.007988 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-c5e3dc35-3c66-458c-a7bf-8a83140e2b13 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.072841 Jun 03 09:51:02.008578 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 15/29] 10.222.0.42 () {64 vars in 1332 bytes} [Fri Jun 3 09:51:01 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:51:04.310204 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-9f161246-1b05-407d-9135-c5dd1045dfe0 admin admin] Calling method '>' {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:51:04.311358 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-9f161246-1b05-407d-9135-c5dd1045dfe0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001585 Jun 03 09:51:04.311795 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 15/30] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jun 3 09:51:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:51:04.370149 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-7ca23193-cc38-4018-87f7-73dcb0689da5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 8192, "id": "4", "name": "m1.large", "disk": 80, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0}} {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:51:04.433946 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-7ca23193-cc38-4018-87f7-73dcb0689da5 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.116044 Jun 03 09:51:04.438056 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 16/31] 10.222.0.42 () {64 vars in 1282 bytes} [Fri Jun 3 09:51:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 09:51:04.449027 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-389be19a-75b3-47a2-9615-f751b1a1fef4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:51:04.527748 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-389be19a-75b3-47a2-9615-f751b1a1fef4 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083299 Jun 03 09:51:04.528337 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 16/32] 10.222.0.42 () {64 vars in 1332 bytes} [Fri Jun 3 09:51:04 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:51:06.839842 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-7ca23193-cc38-4018-87f7-73dcb0689da5 admin admin] Calling method '>' {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:51:06.840868 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-7ca23193-cc38-4018-87f7-73dcb0689da5 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jun 03 09:51:06.841269 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 17/33] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jun 3 09:51:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:51:06.915919 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-992e46ed-01c8-49b0-9f1c-7442795e2bf4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "swap": 0, "id": "5", "os-flavor-access:is_public": true, "vcpus": 8, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "name": "m1.xlarge"}} {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:51:07.332131 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-992e46ed-01c8-49b0-9f1c-7442795e2bf4 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.484925 Jun 03 09:51:07.332690 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 17/34] 10.222.0.42 () {64 vars in 1282 bytes} [Fri Jun 3 09:51:06 2022] POST /compute/v2.1/flavors => generated 408 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:51:07.347079 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-469533a4-a493-4089-8298-8597df48d3eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:51:07.446088 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-469533a4-a493-4089-8298-8597df48d3eb admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105193 Jun 03 09:51:07.446967 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 18/35] 10.222.0.42 () {64 vars in 1332 bytes} [Fri Jun 3 09:51:07 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:51:32.184268 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-992e46ed-01c8-49b0-9f1c-7442795e2bf4 admin admin] Calling method '>' {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:51:32.185278 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-992e46ed-01c8-49b0-9f1c-7442795e2bf4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jun 03 09:51:32.185672 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 18/36] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jun 3 09:51:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:51:32.196286 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG dbcounter [-] [110275] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=110275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:51:32.243409 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-42c516bd-eedb-4186-bc5c-06f6e3c1c7bc admin admin] Calling method '>' {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:51:32.260659 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-42c516bd-eedb-4186-bc5c-06f6e3c1c7bc admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068874 Jun 03 09:51:32.261185 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 19/37] 10.222.0.42 () {60 vars in 1291 bytes} [Fri Jun 3 09:51:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:51:33.251262 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-992e46ed-01c8-49b0-9f1c-7442795e2bf4 admin admin] Calling method '>' {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:51:33.252301 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-992e46ed-01c8-49b0-9f1c-7442795e2bf4 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jun 03 09:51:33.252697 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 19/38] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jun 3 09:51:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:51:33.461621 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-9366719a-e5a2-44b2-94c4-d26893f2ab04 admin admin] Calling method '>' {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:51:33.467629 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.wsgi [None req-9366719a-e5a2-44b2-94c4-d26893f2ab04 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 03 09:51:33.470829 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-9366719a-e5a2-44b2-94c4-d26893f2ab04 admin admin] Request method failure captured: Jun 03 09:51:33.470829 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 03 09:51:33.470829 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: Accept: application/json Jun 03 09:51:33.470829 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: Accept-Encoding: gzip, deflate Jun 03 09:51:33.470829 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: Connection: keep-alive Jun 03 09:51:33.470829 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: Content-Length: 0 Jun 03 09:51:33.470829 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: Host: 10.222.0.42 Jun 03 09:51:33.470829 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: Openstack-Api-Version: compute 2.90 Jun 03 09:51:33.470829 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: Openstack-System-Scope: None Jun 03 09:51:33.470829 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: User-Agent: python-novaclient Jun 03 09:51:33.470829 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Auth-Token: gAAAAABimdmlA6twOWY5QYxZwxGZ5UkZqs8CCitPVyRz7PcFCJUGC-8AfaAQRdxOATjdQDuqxw9CDRYzMsCa6L3jLgEJQPoVaAY604JMX3HNg0N_AQmbpFnC6IJXsSdYaUzBrmyPlPzqYVxLvC9ZWGWshbVExGUYwDHHviH_k3blV-1DjoGFzas Jun 03 09:51:33.470829 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Domain-Id: None Jun 03 09:51:33.470829 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Domain-Name: None Jun 03 09:51:33.470829 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Identity-Status: Confirmed Jun 03 09:51:33.470829 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Is-Admin-Project: True Jun 03 09:51:33.470829 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 09:51:33.470829 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Project-Domain-Id: default Jun 03 09:51:33.470829 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Project-Domain-Name: Default Jun 03 09:51:33.470829 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Project-Id: 53d2a61c9fa84503ab8a6c4eb2d3f27e Jun 03 09:51:33.470829 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Project-Name: admin Jun 03 09:51:33.470829 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Role: member,reader,admin Jun 03 09:51:33.470829 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Roles: member,reader,admin Jun 03 09:51:33.472547 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/53d2a61c9fa84503ab8a6c4eb2d3f27e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/53d2a61c9fa84503ab8a6c4eb2d3f27e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_53d2a61c9fa84503ab8a6c4eb2d3f27e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/53d2a61c9fa84503ab8a6c4eb2d3f27e"}]}] Jun 03 09:51:33.472547 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Tenant: admin Jun 03 09:51:33.472547 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Tenant-Id: 53d2a61c9fa84503ab8a6c4eb2d3f27e Jun 03 09:51:33.472547 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Tenant-Name: admin Jun 03 09:51:33.472547 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-User: admin Jun 03 09:51:33.472547 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-User-Domain-Id: default Jun 03 09:51:33.472547 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-User-Domain-Name: Default Jun 03 09:51:33.472547 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-User-Id: e68f65e605c34489879af9763cddb11c Jun 03 09:51:33.472547 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-User-Name: admin Jun 03 09:51:33.472547 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: method: > Jun 03 09:51:33.472547 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: exception: Flavor 42 could not be found. Jun 03 09:51:33.472547 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: action_args: {'id': '42'} Jun 03 09:51:33.472547 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:51:33.472547 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:51:33.473513 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 09:51:33.473513 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 09:51:33.473513 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 09:51:33.473513 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 09:51:33.473513 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 09:51:33.473513 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 09:51:33.473513 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 09:51:33.473513 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 09:51:33.473513 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 09:51:33.473513 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:51:33.473513 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 09:51:33.473513 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 09:51:33.473513 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 03 09:51:33.473513 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi Jun 03 09:51:33.473513 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:51:33.473513 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi Jun 03 09:51:33.473513 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:51:33.473513 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:51:33.473513 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:51:33.475131 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:51:33.475131 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:51:33.475131 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:51:33.475131 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:51:33.475131 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 09:51:33.475131 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:51:33.475131 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 03 09:51:33.475131 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi Jun 03 09:51:33.475131 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:51:33.475131 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi Jun 03 09:51:33.475131 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:51:33.475131 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:51:33.475131 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:51:33.475131 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:51:33.475131 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:51:33.475131 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 03 09:51:33.475131 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi Jun 03 09:51:33.475131 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-9366719a-e5a2-44b2-94c4-d26893f2ab04 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:51:33.476442 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-9366719a-e5a2-44b2-94c4-d26893f2ab04 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062900 Jun 03 09:51:33.476442 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 20/39] 10.222.0.42 () {60 vars in 1190 bytes} [Fri Jun 3 09:51:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 09:51:33.482535 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-d98c245a-816e-4340-9ab6-05f9bf478c0b admin admin] Calling method '>' {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:51:33.485581 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG dbcounter [-] [110274] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:51:33.503840 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-d98c245a-816e-4340-9ab6-05f9bf478c0b admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024835 Jun 03 09:51:33.508376 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 20/40] 10.222.0.42 () {60 vars in 1210 bytes} [Fri Jun 3 09:51:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:51:33.522251 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-5dfc512f-86b2-4090-8ed0-e462a1ad57f7 admin admin] Calling method '>' {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:51:33.544302 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-5dfc512f-86b2-4090-8ed0-e462a1ad57f7 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025586 Jun 03 09:51:33.544839 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 21/41] 10.222.0.42 () {60 vars in 1210 bytes} [Fri Jun 3 09:51:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:51:33.554230 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-d1baff58-5799-418e-8791-f735054ceb0f admin admin] Calling method '>' {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:51:33.559978 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.wsgi [None req-d1baff58-5799-418e-8791-f735054ceb0f admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 03 09:51:33.563252 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-d1baff58-5799-418e-8791-f735054ceb0f admin admin] Request method failure captured: Jun 03 09:51:33.563252 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 03 09:51:33.563252 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: Accept: application/json Jun 03 09:51:33.563252 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: Accept-Encoding: gzip, deflate Jun 03 09:51:33.563252 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: Connection: keep-alive Jun 03 09:51:33.563252 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: Content-Length: 0 Jun 03 09:51:33.563252 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: Host: 10.222.0.42 Jun 03 09:51:33.563252 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: Openstack-Api-Version: compute 2.90 Jun 03 09:51:33.563252 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: Openstack-System-Scope: None Jun 03 09:51:33.563252 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: User-Agent: python-novaclient Jun 03 09:51:33.563252 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Auth-Token: gAAAAABimdmlA6twOWY5QYxZwxGZ5UkZqs8CCitPVyRz7PcFCJUGC-8AfaAQRdxOATjdQDuqxw9CDRYzMsCa6L3jLgEJQPoVaAY604JMX3HNg0N_AQmbpFnC6IJXsSdYaUzBrmyPlPzqYVxLvC9ZWGWshbVExGUYwDHHviH_k3blV-1DjoGFzas Jun 03 09:51:33.563252 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Domain-Id: None Jun 03 09:51:33.563252 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Domain-Name: None Jun 03 09:51:33.563252 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Identity-Status: Confirmed Jun 03 09:51:33.563252 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Is-Admin-Project: True Jun 03 09:51:33.563252 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 09:51:33.563252 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Project-Domain-Id: default Jun 03 09:51:33.563252 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Project-Domain-Name: Default Jun 03 09:51:33.563252 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Project-Id: 53d2a61c9fa84503ab8a6c4eb2d3f27e Jun 03 09:51:33.563252 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Project-Name: admin Jun 03 09:51:33.563252 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Role: member,reader,admin Jun 03 09:51:33.563252 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Roles: member,reader,admin Jun 03 09:51:33.567421 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/53d2a61c9fa84503ab8a6c4eb2d3f27e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/53d2a61c9fa84503ab8a6c4eb2d3f27e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_53d2a61c9fa84503ab8a6c4eb2d3f27e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/53d2a61c9fa84503ab8a6c4eb2d3f27e"}]}] Jun 03 09:51:33.567421 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Tenant: admin Jun 03 09:51:33.567421 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Tenant-Id: 53d2a61c9fa84503ab8a6c4eb2d3f27e Jun 03 09:51:33.567421 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Tenant-Name: admin Jun 03 09:51:33.567421 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-User: admin Jun 03 09:51:33.567421 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-User-Domain-Id: default Jun 03 09:51:33.567421 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-User-Domain-Name: Default Jun 03 09:51:33.567421 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-User-Id: e68f65e605c34489879af9763cddb11c Jun 03 09:51:33.567421 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-User-Name: admin Jun 03 09:51:33.567421 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: method: > Jun 03 09:51:33.567421 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: exception: Flavor 42 could not be found. Jun 03 09:51:33.567421 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: action_args: {'id': '42'} Jun 03 09:51:33.567421 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:51:33.567421 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:51:33.568502 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 09:51:33.568502 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 09:51:33.568502 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 09:51:33.568502 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 09:51:33.568502 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 09:51:33.568502 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 09:51:33.568502 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 09:51:33.568502 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 09:51:33.568502 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 09:51:33.568502 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:51:33.568502 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 09:51:33.568502 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 09:51:33.568502 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 03 09:51:33.568502 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi Jun 03 09:51:33.568502 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:51:33.568502 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi Jun 03 09:51:33.568502 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:51:33.568502 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:51:33.568502 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:51:33.569846 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:51:33.569846 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:51:33.569846 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:51:33.569846 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:51:33.569846 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 09:51:33.569846 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:51:33.569846 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 03 09:51:33.569846 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi Jun 03 09:51:33.569846 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:51:33.569846 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi Jun 03 09:51:33.569846 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:51:33.569846 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:51:33.569846 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:51:33.569846 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:51:33.569846 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:51:33.569846 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 03 09:51:33.569846 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi Jun 03 09:51:33.569846 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-d1baff58-5799-418e-8791-f735054ceb0f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:51:33.571155 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-d1baff58-5799-418e-8791-f735054ceb0f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014283 Jun 03 09:51:33.571155 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 21/42] 10.222.0.42 () {60 vars in 1190 bytes} [Fri Jun 3 09:51:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 03 09:51:34.436057 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-5dfc512f-86b2-4090-8ed0-e462a1ad57f7 admin admin] Calling method '>' {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:51:34.437066 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-5dfc512f-86b2-4090-8ed0-e462a1ad57f7 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jun 03 09:51:34.437491 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 22/43] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jun 3 09:51:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:51:34.623921 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-cca0937e-a4d9-4186-98dc-f60aa5a98583 admin admin] Calling method '>' {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:51:34.629188 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.wsgi [None req-cca0937e-a4d9-4186-98dc-f60aa5a98583 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 03 09:51:34.630731 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-cca0937e-a4d9-4186-98dc-f60aa5a98583 admin admin] Request method failure captured: Jun 03 09:51:34.630731 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 03 09:51:34.630731 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: Accept: application/json Jun 03 09:51:34.630731 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: Accept-Encoding: gzip, deflate Jun 03 09:51:34.630731 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: Connection: keep-alive Jun 03 09:51:34.630731 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: Content-Length: 0 Jun 03 09:51:34.630731 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: Host: 10.222.0.42 Jun 03 09:51:34.630731 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: Openstack-Api-Version: compute 2.90 Jun 03 09:51:34.630731 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: Openstack-System-Scope: None Jun 03 09:51:34.630731 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: User-Agent: python-novaclient Jun 03 09:51:34.630731 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Auth-Token: gAAAAABimdmmGMC16IT7teAOOFaz_ZqoFBNMVl7AXxgkRECsLnOoadLzSu4G4YpbERF9zh0dCsIX5W5F2PSUhAAeBSnM1XuL3OetogLgG0BjWjbIFNPuIx0OlGQM1eGkMArJRKzw1sjvfhY8jHr71SV_1oA_igoSuQUwxXub4jme0h39TYu8eI8 Jun 03 09:51:34.630731 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Domain-Id: None Jun 03 09:51:34.630731 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Domain-Name: None Jun 03 09:51:34.630731 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Identity-Status: Confirmed Jun 03 09:51:34.630731 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Is-Admin-Project: True Jun 03 09:51:34.630731 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 09:51:34.630731 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Project-Domain-Id: default Jun 03 09:51:34.630731 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Project-Domain-Name: Default Jun 03 09:51:34.630731 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Project-Id: 53d2a61c9fa84503ab8a6c4eb2d3f27e Jun 03 09:51:34.630731 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Project-Name: admin Jun 03 09:51:34.630731 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Role: member,reader,admin Jun 03 09:51:34.630731 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Roles: member,reader,admin Jun 03 09:51:34.632255 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/53d2a61c9fa84503ab8a6c4eb2d3f27e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/53d2a61c9fa84503ab8a6c4eb2d3f27e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_53d2a61c9fa84503ab8a6c4eb2d3f27e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/53d2a61c9fa84503ab8a6c4eb2d3f27e"}]}] Jun 03 09:51:34.632255 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Tenant: admin Jun 03 09:51:34.632255 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Tenant-Id: 53d2a61c9fa84503ab8a6c4eb2d3f27e Jun 03 09:51:34.632255 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Tenant-Name: admin Jun 03 09:51:34.632255 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-User: admin Jun 03 09:51:34.632255 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-User-Domain-Id: default Jun 03 09:51:34.632255 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-User-Domain-Name: Default Jun 03 09:51:34.632255 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-User-Id: e68f65e605c34489879af9763cddb11c Jun 03 09:51:34.632255 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-User-Name: admin Jun 03 09:51:34.632255 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: method: > Jun 03 09:51:34.632255 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: exception: Flavor 84 could not be found. Jun 03 09:51:34.632255 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: action_args: {'id': '84'} Jun 03 09:51:34.632255 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:51:34.632255 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:51:34.633145 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 09:51:34.633145 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 09:51:34.633145 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 09:51:34.633145 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 09:51:34.633145 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 09:51:34.633145 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 09:51:34.633145 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 09:51:34.633145 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 09:51:34.633145 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 09:51:34.633145 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:51:34.633145 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 09:51:34.633145 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 09:51:34.633145 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 03 09:51:34.633145 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi Jun 03 09:51:34.633145 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:51:34.633145 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi Jun 03 09:51:34.633145 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:51:34.633145 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:51:34.633145 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:51:34.634866 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:51:34.634866 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:51:34.634866 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:51:34.634866 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:51:34.634866 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 09:51:34.634866 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:51:34.634866 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 03 09:51:34.634866 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi Jun 03 09:51:34.634866 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:51:34.634866 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi Jun 03 09:51:34.634866 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:51:34.634866 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:51:34.634866 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:51:34.634866 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:51:34.634866 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:51:34.634866 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 03 09:51:34.634866 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi Jun 03 09:51:34.634866 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-cca0937e-a4d9-4186-98dc-f60aa5a98583 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:51:34.636139 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-cca0937e-a4d9-4186-98dc-f60aa5a98583 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059507 Jun 03 09:51:34.636139 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 22/44] 10.222.0.42 () {60 vars in 1190 bytes} [Fri Jun 3 09:51:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 09:51:34.642659 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-409a1ff8-873f-408b-8e96-ed749ac9c86a admin admin] Calling method '>' {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:51:34.657431 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-409a1ff8-873f-408b-8e96-ed749ac9c86a admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018638 Jun 03 09:51:34.657919 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 23/45] 10.222.0.42 () {60 vars in 1210 bytes} [Fri Jun 3 09:51:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:51:34.667239 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-0a0ce886-99e7-4fca-b797-0e36799620af admin admin] Calling method '>' {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:51:34.680489 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-0a0ce886-99e7-4fca-b797-0e36799620af admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017034 Jun 03 09:51:34.680998 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 23/46] 10.222.0.42 () {60 vars in 1210 bytes} [Fri Jun 3 09:51:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:51:34.689895 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-ef7fd11b-8752-45c9-870e-16ce04bddb4a admin admin] Calling method '>' {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:51:34.695176 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.wsgi [None req-ef7fd11b-8752-45c9-870e-16ce04bddb4a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 03 09:51:34.697188 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-ef7fd11b-8752-45c9-870e-16ce04bddb4a admin admin] Request method failure captured: Jun 03 09:51:34.697188 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 03 09:51:34.697188 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: Accept: application/json Jun 03 09:51:34.697188 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: Accept-Encoding: gzip, deflate Jun 03 09:51:34.697188 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: Connection: keep-alive Jun 03 09:51:34.697188 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: Content-Length: 0 Jun 03 09:51:34.697188 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: Host: 10.222.0.42 Jun 03 09:51:34.697188 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: Openstack-Api-Version: compute 2.90 Jun 03 09:51:34.697188 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: Openstack-System-Scope: None Jun 03 09:51:34.697188 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: User-Agent: python-novaclient Jun 03 09:51:34.697188 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Auth-Token: gAAAAABimdmmGMC16IT7teAOOFaz_ZqoFBNMVl7AXxgkRECsLnOoadLzSu4G4YpbERF9zh0dCsIX5W5F2PSUhAAeBSnM1XuL3OetogLgG0BjWjbIFNPuIx0OlGQM1eGkMArJRKzw1sjvfhY8jHr71SV_1oA_igoSuQUwxXub4jme0h39TYu8eI8 Jun 03 09:51:34.697188 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Domain-Id: None Jun 03 09:51:34.697188 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Domain-Name: None Jun 03 09:51:34.697188 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Identity-Status: Confirmed Jun 03 09:51:34.697188 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Is-Admin-Project: True Jun 03 09:51:34.697188 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 09:51:34.697188 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Project-Domain-Id: default Jun 03 09:51:34.697188 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Project-Domain-Name: Default Jun 03 09:51:34.697188 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Project-Id: 53d2a61c9fa84503ab8a6c4eb2d3f27e Jun 03 09:51:34.697188 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Project-Name: admin Jun 03 09:51:34.697188 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Role: member,reader,admin Jun 03 09:51:34.697188 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Roles: member,reader,admin Jun 03 09:51:34.698761 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/53d2a61c9fa84503ab8a6c4eb2d3f27e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/53d2a61c9fa84503ab8a6c4eb2d3f27e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_53d2a61c9fa84503ab8a6c4eb2d3f27e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/53d2a61c9fa84503ab8a6c4eb2d3f27e"}]}] Jun 03 09:51:34.698761 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Tenant: admin Jun 03 09:51:34.698761 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Tenant-Id: 53d2a61c9fa84503ab8a6c4eb2d3f27e Jun 03 09:51:34.698761 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Tenant-Name: admin Jun 03 09:51:34.698761 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-User: admin Jun 03 09:51:34.698761 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-User-Domain-Id: default Jun 03 09:51:34.698761 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-User-Domain-Name: Default Jun 03 09:51:34.698761 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-User-Id: e68f65e605c34489879af9763cddb11c Jun 03 09:51:34.698761 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-User-Name: admin Jun 03 09:51:34.698761 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: method: > Jun 03 09:51:34.698761 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: exception: Flavor 84 could not be found. Jun 03 09:51:34.698761 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: action_args: {'id': '84'} Jun 03 09:51:34.698761 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:51:34.698761 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:51:34.699696 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 09:51:34.699696 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 09:51:34.699696 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 09:51:34.699696 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 09:51:34.699696 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 09:51:34.699696 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 09:51:34.699696 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 09:51:34.699696 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 09:51:34.699696 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 09:51:34.699696 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:51:34.699696 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 09:51:34.699696 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 09:51:34.699696 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 03 09:51:34.699696 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi Jun 03 09:51:34.699696 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:51:34.699696 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi Jun 03 09:51:34.699696 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:51:34.699696 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:51:34.699696 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:51:34.700784 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:51:34.700784 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:51:34.700784 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:51:34.700784 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:51:34.700784 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 09:51:34.700784 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:51:34.700784 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 03 09:51:34.700784 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi Jun 03 09:51:34.700784 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:51:34.700784 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi Jun 03 09:51:34.700784 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:51:34.700784 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:51:34.700784 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:51:34.700784 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:51:34.700784 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:51:34.700784 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 03 09:51:34.700784 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi Jun 03 09:51:34.700784 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-ef7fd11b-8752-45c9-870e-16ce04bddb4a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:51:34.701802 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-ef7fd11b-8752-45c9-870e-16ce04bddb4a admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012121 Jun 03 09:51:34.701802 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 24/47] 10.222.0.42 () {60 vars in 1190 bytes} [Fri Jun 3 09:51:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 03 09:51:35.561128 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-0a0ce886-99e7-4fca-b797-0e36799620af admin admin] Calling method '>' {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:51:35.562169 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-0a0ce886-99e7-4fca-b797-0e36799620af admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jun 03 09:51:35.562564 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 24/48] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jun 3 09:51:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:51:35.749796 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-4ef19f02-aee1-4160-bff1-cdc1ac071153 admin admin] Calling method '>' {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:51:35.755483 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.wsgi [None req-4ef19f02-aee1-4160-bff1-cdc1ac071153 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 03 09:51:35.756989 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-4ef19f02-aee1-4160-bff1-cdc1ac071153 admin admin] Request method failure captured: Jun 03 09:51:35.756989 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 03 09:51:35.756989 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: Accept: application/json Jun 03 09:51:35.756989 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: Accept-Encoding: gzip, deflate Jun 03 09:51:35.756989 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: Connection: keep-alive Jun 03 09:51:35.756989 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: Content-Length: 0 Jun 03 09:51:35.756989 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: Host: 10.222.0.42 Jun 03 09:51:35.756989 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: Openstack-Api-Version: compute 2.90 Jun 03 09:51:35.756989 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: Openstack-System-Scope: None Jun 03 09:51:35.756989 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: User-Agent: python-novaclient Jun 03 09:51:35.756989 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Auth-Token: gAAAAABimdmnv1zvnvCEaSxUpigZRJ8vS7zN2XbQqhnevfXQbSAJLLH7oRGKuBSU1uS4-_IUoE6K7hKBx-hL_FR9CHKrFYh6USPNldTX-2bwD082nr0HMi8XQX3m75ilGiyWQikNcxpjs62R2thE0rG1nKme7sz3joMCDFqWkGeXnIUuGkPDX-s Jun 03 09:51:35.756989 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Domain-Id: None Jun 03 09:51:35.756989 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Domain-Name: None Jun 03 09:51:35.756989 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Identity-Status: Confirmed Jun 03 09:51:35.756989 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Is-Admin-Project: True Jun 03 09:51:35.756989 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 09:51:35.756989 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Project-Domain-Id: default Jun 03 09:51:35.756989 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Project-Domain-Name: Default Jun 03 09:51:35.756989 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Project-Id: 53d2a61c9fa84503ab8a6c4eb2d3f27e Jun 03 09:51:35.756989 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Project-Name: admin Jun 03 09:51:35.756989 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Role: member,reader,admin Jun 03 09:51:35.756989 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Roles: member,reader,admin Jun 03 09:51:35.758547 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/53d2a61c9fa84503ab8a6c4eb2d3f27e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/53d2a61c9fa84503ab8a6c4eb2d3f27e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_53d2a61c9fa84503ab8a6c4eb2d3f27e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/53d2a61c9fa84503ab8a6c4eb2d3f27e"}]}] Jun 03 09:51:35.758547 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Tenant: admin Jun 03 09:51:35.758547 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Tenant-Id: 53d2a61c9fa84503ab8a6c4eb2d3f27e Jun 03 09:51:35.758547 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-Tenant-Name: admin Jun 03 09:51:35.758547 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-User: admin Jun 03 09:51:35.758547 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-User-Domain-Id: default Jun 03 09:51:35.758547 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-User-Domain-Name: Default Jun 03 09:51:35.758547 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-User-Id: e68f65e605c34489879af9763cddb11c Jun 03 09:51:35.758547 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: X-User-Name: admin Jun 03 09:51:35.758547 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: method: > Jun 03 09:51:35.758547 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: exception: Flavor 451 could not be found. Jun 03 09:51:35.758547 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: action_args: {'id': '451'} Jun 03 09:51:35.758547 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:51:35.758547 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:51:35.759454 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 09:51:35.759454 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 09:51:35.759454 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 09:51:35.759454 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 09:51:35.759454 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 09:51:35.759454 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 09:51:35.759454 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 09:51:35.759454 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 09:51:35.759454 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 09:51:35.759454 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:51:35.759454 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 09:51:35.759454 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 09:51:35.759454 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 03 09:51:35.759454 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi Jun 03 09:51:35.759454 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:51:35.759454 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi Jun 03 09:51:35.759454 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:51:35.759454 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:51:35.759454 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:51:35.760730 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:51:35.760730 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:51:35.760730 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:51:35.760730 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:51:35.760730 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 09:51:35.760730 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:51:35.760730 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 03 09:51:35.760730 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi Jun 03 09:51:35.760730 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:51:35.760730 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi Jun 03 09:51:35.760730 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:51:35.760730 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:51:35.760730 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:51:35.760730 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:51:35.760730 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:51:35.760730 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 03 09:51:35.760730 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: ERROR nova.api.openstack.wsgi Jun 03 09:51:35.760730 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-4ef19f02-aee1-4160-bff1-cdc1ac071153 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:51:35.762089 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-4ef19f02-aee1-4160-bff1-cdc1ac071153 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060573 Jun 03 09:51:35.762089 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 25/49] 10.222.0.42 () {60 vars in 1193 bytes} [Fri Jun 3 09:51:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 09:51:35.768052 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-b6a2a5a8-0772-4c41-9ae6-5e668240c993 admin admin] Calling method '>' {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:51:35.782417 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-b6a2a5a8-0772-4c41-9ae6-5e668240c993 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017853 Jun 03 09:51:35.782883 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 25/50] 10.222.0.42 () {60 vars in 1210 bytes} [Fri Jun 3 09:51:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:51:35.791789 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-1c7605c9-4448-42eb-98d6-f2a98c8f5a1a admin admin] Calling method '>' {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:51:35.805002 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-1c7605c9-4448-42eb-98d6-f2a98c8f5a1a admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016729 Jun 03 09:51:35.805513 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 26/51] 10.222.0.42 () {60 vars in 1210 bytes} [Fri Jun 3 09:51:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:51:35.814822 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-2c714547-1a42-4599-95a0-1a49e129afaf admin admin] Calling method '>' {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:51:35.820118 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.wsgi [None req-2c714547-1a42-4599-95a0-1a49e129afaf admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 03 09:51:35.822249 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-2c714547-1a42-4599-95a0-1a49e129afaf admin admin] Request method failure captured: Jun 03 09:51:35.822249 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 03 09:51:35.822249 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: Accept: application/json Jun 03 09:51:35.822249 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: Accept-Encoding: gzip, deflate Jun 03 09:51:35.822249 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: Connection: keep-alive Jun 03 09:51:35.822249 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: Content-Length: 0 Jun 03 09:51:35.822249 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: Host: 10.222.0.42 Jun 03 09:51:35.822249 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: Openstack-Api-Version: compute 2.90 Jun 03 09:51:35.822249 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: Openstack-System-Scope: None Jun 03 09:51:35.822249 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: User-Agent: python-novaclient Jun 03 09:51:35.822249 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Auth-Token: gAAAAABimdmnv1zvnvCEaSxUpigZRJ8vS7zN2XbQqhnevfXQbSAJLLH7oRGKuBSU1uS4-_IUoE6K7hKBx-hL_FR9CHKrFYh6USPNldTX-2bwD082nr0HMi8XQX3m75ilGiyWQikNcxpjs62R2thE0rG1nKme7sz3joMCDFqWkGeXnIUuGkPDX-s Jun 03 09:51:35.822249 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Domain-Id: None Jun 03 09:51:35.822249 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Domain-Name: None Jun 03 09:51:35.822249 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Identity-Status: Confirmed Jun 03 09:51:35.822249 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Is-Admin-Project: True Jun 03 09:51:35.822249 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 09:51:35.822249 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Project-Domain-Id: default Jun 03 09:51:35.822249 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Project-Domain-Name: Default Jun 03 09:51:35.822249 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Project-Id: 53d2a61c9fa84503ab8a6c4eb2d3f27e Jun 03 09:51:35.822249 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Project-Name: admin Jun 03 09:51:35.822249 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Role: member,reader,admin Jun 03 09:51:35.822249 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Roles: member,reader,admin Jun 03 09:51:35.823796 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/53d2a61c9fa84503ab8a6c4eb2d3f27e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/53d2a61c9fa84503ab8a6c4eb2d3f27e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_53d2a61c9fa84503ab8a6c4eb2d3f27e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/53d2a61c9fa84503ab8a6c4eb2d3f27e"}]}] Jun 03 09:51:35.823796 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Tenant: admin Jun 03 09:51:35.823796 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Tenant-Id: 53d2a61c9fa84503ab8a6c4eb2d3f27e Jun 03 09:51:35.823796 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-Tenant-Name: admin Jun 03 09:51:35.823796 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-User: admin Jun 03 09:51:35.823796 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-User-Domain-Id: default Jun 03 09:51:35.823796 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-User-Domain-Name: Default Jun 03 09:51:35.823796 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-User-Id: e68f65e605c34489879af9763cddb11c Jun 03 09:51:35.823796 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: X-User-Name: admin Jun 03 09:51:35.823796 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: method: > Jun 03 09:51:35.823796 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: exception: Flavor 451 could not be found. Jun 03 09:51:35.823796 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: action_args: {'id': '451'} Jun 03 09:51:35.823796 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:51:35.823796 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:51:35.824759 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 09:51:35.824759 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 09:51:35.824759 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 09:51:35.824759 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 09:51:35.824759 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 09:51:35.824759 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 09:51:35.824759 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 09:51:35.824759 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 09:51:35.824759 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 09:51:35.824759 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:51:35.824759 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 09:51:35.824759 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 09:51:35.824759 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 03 09:51:35.824759 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi Jun 03 09:51:35.824759 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:51:35.824759 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi Jun 03 09:51:35.824759 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:51:35.824759 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:51:35.824759 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:51:35.826077 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:51:35.826077 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:51:35.826077 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:51:35.826077 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:51:35.826077 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 09:51:35.826077 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:51:35.826077 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 03 09:51:35.826077 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi Jun 03 09:51:35.826077 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:51:35.826077 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi Jun 03 09:51:35.826077 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:51:35.826077 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:51:35.826077 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:51:35.826077 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:51:35.826077 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:51:35.826077 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 03 09:51:35.826077 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: ERROR nova.api.openstack.wsgi Jun 03 09:51:35.826077 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-2c714547-1a42-4599-95a0-1a49e129afaf admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110274) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:51:35.827315 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-2c714547-1a42-4599-95a0-1a49e129afaf admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012228 Jun 03 09:51:35.827315 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 26/52] 10.222.0.42 () {60 vars in 1193 bytes} [Fri Jun 3 09:51:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 09:51:36.684090 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-1c7605c9-4448-42eb-98d6-f2a98c8f5a1a admin admin] Calling method '>' {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:51:36.685097 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-1c7605c9-4448-42eb-98d6-f2a98c8f5a1a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jun 03 09:51:36.685502 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 27/53] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jun 3 09:51:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:51:36.872677 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-ca33e1e9-b900-4166-917d-2911e1492528 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:51:36.945729 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-ca33e1e9-b900-4166-917d-2911e1492528 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.123726 Jun 03 09:51:36.946284 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 27/54] 10.222.0.42 () {64 vars in 1235 bytes} [Fri Jun 3 09:51:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:51:37.811380 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-1c7605c9-4448-42eb-98d6-f2a98c8f5a1a admin admin] Calling method '>' {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:51:37.812381 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-1c7605c9-4448-42eb-98d6-f2a98c8f5a1a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jun 03 09:51:37.812772 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 28/55] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jun 3 09:51:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:51:38.001417 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-2ade528e-bdf3-443a-a973-ff6eedaa1c28 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:51:38.215191 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-2ade528e-bdf3-443a-a973-ff6eedaa1c28 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.265396 Jun 03 09:51:38.215673 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 28/56] 10.222.0.42 () {64 vars in 1235 bytes} [Fri Jun 3 09:51:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:51:39.073064 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-1c7605c9-4448-42eb-98d6-f2a98c8f5a1a admin admin] Calling method '>' {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:51:39.074115 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-1c7605c9-4448-42eb-98d6-f2a98c8f5a1a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jun 03 09:51:39.074512 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 29/57] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jun 3 09:51:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:51:39.262672 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-49983ea1-aeb5-467c-b9e1-403fd4294573 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:51:39.340263 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-49983ea1-aeb5-467c-b9e1-403fd4294573 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.129711 Jun 03 09:51:39.340805 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 29/58] 10.222.0.42 () {64 vars in 1235 bytes} [Fri Jun 3 09:51:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:51:40.196253 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-1c7605c9-4448-42eb-98d6-f2a98c8f5a1a admin admin] Calling method '>' {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:51:40.197285 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-1c7605c9-4448-42eb-98d6-f2a98c8f5a1a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jun 03 09:51:40.197683 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 30/59] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jun 3 09:51:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:51:40.383783 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-2e30ce4a-58a4-4cab-8fba-2db164e3b659 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:51:40.477063 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-2e30ce4a-58a4-4cab-8fba-2db164e3b659 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.143348 Jun 03 09:51:40.478186 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 30/60] 10.222.0.42 () {64 vars in 1235 bytes} [Fri Jun 3 09:51:40 2022] POST /compute/v2.1/flavors => generated 409 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:51:41.345219 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-1c7605c9-4448-42eb-98d6-f2a98c8f5a1a admin admin] Calling method '>' {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:51:41.346242 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-1c7605c9-4448-42eb-98d6-f2a98c8f5a1a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Jun 03 09:51:41.346629 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 31/61] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jun 3 09:51:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:51:41.533896 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-a792678b-c225-4248-a8e5-3270ec74eb12 admin admin] Calling method '>' {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:51:41.553582 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-a792678b-c225-4248-a8e5-3270ec74eb12 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072324 Jun 03 09:51:41.554158 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 31/62] 10.222.0.42 () {60 vars in 1202 bytes} [Fri Jun 3 09:51:41 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:52:42.183715 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-1c7605c9-4448-42eb-98d6-f2a98c8f5a1a admin admin] Calling method '>' {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:52:42.184724 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-1c7605c9-4448-42eb-98d6-f2a98c8f5a1a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jun 03 09:52:42.185121 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 32/63] 10.222.0.42 () {54 vars in 930 bytes} [Fri Jun 3 09:52:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:52:42.192402 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG dbcounter [-] [110274] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:52:42.243529 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-2eaa387b-6a13-4c0d-b7e7-3d925bc52126 admin admin] Calling method '>' {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:52:42.262793 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-2eaa387b-6a13-4c0d-b7e7-3d925bc52126 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071800 Jun 03 09:52:42.263330 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 32/64] 10.222.0.42 () {60 vars in 1291 bytes} [Fri Jun 3 09:52:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:52:42.283690 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG dbcounter [-] [110275] Writing DB stats nova_api:SELECT=14 {{(pid=110275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:52:42.287890 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-660d8384-2b97-415e-a59e-e2651fc56011 admin admin] Calling method '>' {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:52:42.295303 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-660d8384-2b97-415e-a59e-e2651fc56011 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013073 Jun 03 09:52:42.295822 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 33/65] 10.222.0.42 () {60 vars in 1282 bytes} [Fri Jun 3 09:52:42 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:52:42.307747 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-5077e05a-3710-43bf-81bd-1cdb6f89f42e admin admin] Calling method '>' {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:52:42.315698 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-5077e05a-3710-43bf-81bd-1cdb6f89f42e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011822 Jun 03 09:52:42.316206 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 33/66] 10.222.0.42 () {60 vars in 1285 bytes} [Fri Jun 3 09:52:42 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:52:42.327168 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-94233d0c-18ab-4df9-887e-514752fbc0f0 admin admin] Calling method '>' {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:52:42.334868 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-94233d0c-18ab-4df9-887e-514752fbc0f0 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011169 Jun 03 09:52:42.335376 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 34/67] 10.222.0.42 () {60 vars in 1285 bytes} [Fri Jun 3 09:52:42 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:52:42.346074 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-1ca1c9df-89f1-414d-8165-773ee3f08d40 admin admin] Calling method '>' {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:52:42.353876 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-1ca1c9df-89f1-414d-8165-773ee3f08d40 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011183 Jun 03 09:52:42.354395 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 34/68] 10.222.0.42 () {60 vars in 1282 bytes} [Fri Jun 3 09:52:42 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:56:09.111542 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-94233d0c-18ab-4df9-887e-514752fbc0f0 admin admin] Calling method '>' {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:09.112591 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-94233d0c-18ab-4df9-887e-514752fbc0f0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jun 03 09:56:09.112992 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 35/69] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jun 3 09:56:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:56:09.265797 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG dbcounter [-] [110274] Writing DB stats nova_api:SELECT=6 {{(pid=110274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:09.377030 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-7e01fa6b-3d5f-49a6-9336-62756c1247b5 admin admin] Calling method '>' {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:09.378205 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:56:09.378205 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: warnings.warn(msg) Jun 03 09:56:09.379394 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG oslo_concurrency.lockutils [None req-7e01fa6b-3d5f-49a6-9336-62756c1247b5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:09.379832 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG oslo_concurrency.lockutils [None req-7e01fa6b-3d5f-49a6-9336-62756c1247b5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:09.380604 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG oslo_concurrency.lockutils [None req-7e01fa6b-3d5f-49a6-9336-62756c1247b5 admin admin] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:09.381025 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG oslo_concurrency.lockutils [None req-7e01fa6b-3d5f-49a6-9336-62756c1247b5 admin admin] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:09.415291 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-7e01fa6b-3d5f-49a6-9336-62756c1247b5 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.151614 Jun 03 09:56:09.415854 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 35/70] 10.222.0.42 () {60 vars in 1193 bytes} [Fri Jun 3 09:56:09 2022] GET /compute/v2.1/os-services => generated 791 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:56:10.286486 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-94233d0c-18ab-4df9-887e-514752fbc0f0 admin admin] Calling method '>' {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:10.287487 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-94233d0c-18ab-4df9-887e-514752fbc0f0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 03 09:56:10.287882 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 36/71] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jun 3 09:56:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:56:10.473408 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-17d36e63-701f-4c6d-a5ee-7e561bb703f1 admin admin] Calling method '>' {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:10.474606 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:56:10.474606 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: warnings.warn(msg) Jun 03 09:56:10.475858 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG oslo_concurrency.lockutils [None req-17d36e63-701f-4c6d-a5ee-7e561bb703f1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:10.476280 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG oslo_concurrency.lockutils [None req-17d36e63-701f-4c6d-a5ee-7e561bb703f1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:10.477076 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG oslo_concurrency.lockutils [None req-17d36e63-701f-4c6d-a5ee-7e561bb703f1 admin admin] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:10.477506 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG oslo_concurrency.lockutils [None req-17d36e63-701f-4c6d-a5ee-7e561bb703f1 admin admin] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:10.498432 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-17d36e63-701f-4c6d-a5ee-7e561bb703f1 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074821 Jun 03 09:56:10.498947 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 36/72] 10.222.0.42 () {60 vars in 1193 bytes} [Fri Jun 3 09:56:10 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 09:56:21.770649 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-94233d0c-18ab-4df9-887e-514752fbc0f0 admin admin] Calling method '>' {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:21.771687 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-94233d0c-18ab-4df9-887e-514752fbc0f0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jun 03 09:56:21.772086 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 37/73] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jun 3 09:56:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:56:21.916793 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG dbcounter [-] [110274] Writing DB stats nova_cell0:SELECT=4 {{(pid=110274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:21.917515 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG dbcounter [-] [110274] Writing DB stats nova_cell1:SELECT=4 {{(pid=110274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:21.918207 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG dbcounter [-] [110274] Writing DB stats nova_api:SELECT=8 {{(pid=110274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:21.967868 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-726dc0a1-9a1a-4f7c-be6a-1c3abf1a59d6 admin admin] Calling method '>' {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:21.969241 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:56:21.969241 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: warnings.warn(msg) Jun 03 09:56:21.971222 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG oslo_concurrency.lockutils [None req-726dc0a1-9a1a-4f7c-be6a-1c3abf1a59d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:21.976928 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG oslo_concurrency.lockutils [None req-726dc0a1-9a1a-4f7c-be6a-1c3abf1a59d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:21.978431 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG oslo_concurrency.lockutils [None req-726dc0a1-9a1a-4f7c-be6a-1c3abf1a59d6 admin admin] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:21.978431 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG oslo_concurrency.lockutils [None req-726dc0a1-9a1a-4f7c-be6a-1c3abf1a59d6 admin admin] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:22.005123 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-726dc0a1-9a1a-4f7c-be6a-1c3abf1a59d6 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.092673 Jun 03 09:56:22.007110 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 37/74] 10.222.0.42 () {60 vars in 1193 bytes} [Fri Jun 3 09:56:21 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:56:22.870933 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: DEBUG nova.api.openstack.wsgi [None req-94233d0c-18ab-4df9-887e-514752fbc0f0 admin admin] Calling method '>' {{(pid=110275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:22.871941 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: INFO nova.api.openstack.requestlog [None req-94233d0c-18ab-4df9-887e-514752fbc0f0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 03 09:56:22.872335 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: [pid: 110275|app: 0|req: 38/75] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Jun 3 09:56:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:56:23.059773 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG nova.api.openstack.wsgi [None req-bd97500f-097e-4563-bb1a-576d80bda70c admin admin] Calling method '>' {{(pid=110274) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:23.061435 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:56:23.061435 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: warnings.warn(msg) Jun 03 09:56:23.062709 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG oslo_concurrency.lockutils [None req-bd97500f-097e-4563-bb1a-576d80bda70c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:23.063447 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG oslo_concurrency.lockutils [None req-bd97500f-097e-4563-bb1a-576d80bda70c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:23.064220 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG oslo_concurrency.lockutils [None req-bd97500f-097e-4563-bb1a-576d80bda70c admin admin] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:23.064642 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: DEBUG oslo_concurrency.lockutils [None req-bd97500f-097e-4563-bb1a-576d80bda70c admin admin] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110274) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:23.086514 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: INFO nova.api.openstack.requestlog [None req-bd97500f-097e-4563-bb1a-576d80bda70c admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077736 Jun 03 09:56:23.087062 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: [pid: 110274|app: 0|req: 38/76] 10.222.0.42 () {60 vars in 1193 bytes} [Fri Jun 3 09:56:23 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:57:21.760636 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: Fri Jun 3 09:57:21 2022 - graceful shutdown triggered... Jun 03 09:57:21.760730 dv-cinder-844563-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 03 09:57:21.761756 dv-cinder-844563-1-iscsi devstack@n-api.service[110274]: Gracefully killing worker 1 (pid: 110274)... Jun 03 09:57:21.762246 dv-cinder-844563-1-iscsi devstack@n-api.service[110275]: Gracefully killing worker 2 (pid: 110275)... Jun 03 09:57:22.762813 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: worker 1 buried after 1 seconds Jun 03 09:57:22.763995 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: worker 2 buried after 1 seconds Jun 03 09:57:22.763995 dv-cinder-844563-1-iscsi devstack@n-api.service[110273]: goodbye to uWSGI. Jun 03 09:57:22.765111 dv-cinder-844563-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 03 09:57:22.765658 dv-cinder-844563-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 03 09:57:22.768436 dv-cinder-844563-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 03 09:57:22.783700 dv-cinder-844563-1-iscsi devstack@n-api.service[125047]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 03 09:57:22.797945 dv-cinder-844563-1-iscsi devstack@n-api.service[125047]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 3 09:57:22 2022] *** Jun 03 09:57:22.797945 dv-cinder-844563-1-iscsi devstack@n-api.service[125047]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 03 09:57:22.797945 dv-cinder-844563-1-iscsi devstack@n-api.service[125047]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 03 09:57:22.797945 dv-cinder-844563-1-iscsi devstack@n-api.service[125047]: nodename: dv-cinder-844563-1-iscsi Jun 03 09:57:22.797945 dv-cinder-844563-1-iscsi devstack@n-api.service[125047]: machine: x86_64 Jun 03 09:57:22.797945 dv-cinder-844563-1-iscsi devstack@n-api.service[125047]: clock source: unix Jun 03 09:57:22.797945 dv-cinder-844563-1-iscsi devstack@n-api.service[125047]: pcre jit disabled Jun 03 09:57:22.797945 dv-cinder-844563-1-iscsi devstack@n-api.service[125047]: detected number of CPU cores: 4 Jun 03 09:57:22.797945 dv-cinder-844563-1-iscsi devstack@n-api.service[125047]: current working directory: / Jun 03 09:57:22.797945 dv-cinder-844563-1-iscsi devstack@n-api.service[125047]: detected binary path: /usr/bin/uwsgi-core Jun 03 09:57:22.798692 dv-cinder-844563-1-iscsi devstack@n-api.service[125047]: your processes number limit is 47680 Jun 03 09:57:22.798692 dv-cinder-844563-1-iscsi devstack@n-api.service[125047]: your memory page size is 4096 bytes Jun 03 09:57:22.798692 dv-cinder-844563-1-iscsi devstack@n-api.service[125047]: detected max file descriptor number: 2048 Jun 03 09:57:22.798692 dv-cinder-844563-1-iscsi devstack@n-api.service[125047]: lock engine: pthread robust mutexes Jun 03 09:57:22.798692 dv-cinder-844563-1-iscsi devstack@n-api.service[125047]: thunder lock: enabled Jun 03 09:57:22.798692 dv-cinder-844563-1-iscsi devstack@n-api.service[125047]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 03 09:57:22.798692 dv-cinder-844563-1-iscsi devstack@n-api.service[125047]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 03 09:57:22.844809 dv-cinder-844563-1-iscsi devstack@n-api.service[125047]: Python main interpreter initialized at 0x55cfeec9c9c0 Jun 03 09:57:22.844809 dv-cinder-844563-1-iscsi devstack@n-api.service[125047]: python threads support enabled Jun 03 09:57:22.844809 dv-cinder-844563-1-iscsi devstack@n-api.service[125047]: your server socket listen backlog is limited to 100 connections Jun 03 09:57:22.844809 dv-cinder-844563-1-iscsi devstack@n-api.service[125047]: your mercy for graceful operations on workers is 90 seconds Jun 03 09:57:22.845249 dv-cinder-844563-1-iscsi devstack@n-api.service[125047]: mapped 403077 bytes (393 KB) for 2 cores Jun 03 09:57:22.845249 dv-cinder-844563-1-iscsi devstack@n-api.service[125047]: *** Operational MODE: preforking *** Jun 03 09:57:22.845519 dv-cinder-844563-1-iscsi devstack@n-api.service[125047]: *** uWSGI is running in multiple interpreter mode *** Jun 03 09:57:22.845519 dv-cinder-844563-1-iscsi devstack@n-api.service[125047]: spawned uWSGI master process (pid: 125047) Jun 03 09:57:22.845722 dv-cinder-844563-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 03 09:57:22.846816 dv-cinder-844563-1-iscsi devstack@n-api.service[125047]: spawned uWSGI worker 1 (pid: 125065, cores: 1) Jun 03 09:57:22.846816 dv-cinder-844563-1-iscsi devstack@n-api.service[125047]: spawned uWSGI worker 2 (pid: 125066, cores: 1) Jun 03 09:57:22.847005 dv-cinder-844563-1-iscsi devstack@n-api.service[125047]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 03 09:57:24.072416 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 03 09:57:24.085460 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 03 09:57:24.897038 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 09:57:24.897038 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: from cryptography.utils import int_from_bytes Jun 03 09:57:24.897356 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 09:57:24.897356 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: from cryptography.utils import int_from_bytes Jun 03 09:57:24.907849 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 09:57:24.907849 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: from cryptography.utils import int_from_bytes Jun 03 09:57:24.908183 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 09:57:24.908183 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: from cryptography.utils import int_from_bytes Jun 03 09:57:27.250743 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 09:57:27.251166 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 09:57:27.251519 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 09:57:27.251878 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 09:57:27.252134 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 09:57:27.252520 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.252843 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.253161 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.253474 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.253799 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.254141 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.254460 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.254775 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.255098 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.255358 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.255681 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.256003 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-1-iscsi {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.256322 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.256627 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.256934 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.257250 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.257552 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.257870 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.258200 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.258695 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.260140 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.260140 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.260140 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.260140 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.260524 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.260662 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.260982 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.261290 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.261612 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.261939 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.262347 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-1-iscsi {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.262662 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.263002 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.263574 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.263988 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.264296 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.264603 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.264919 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.265238 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.265543 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.265866 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.266203 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.266519 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.266833 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.267131 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.267437 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.267744 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.268068 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.268377 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.268683 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.268936 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.269240 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.269556 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.269871 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.270211 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.270461 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.270711 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.271041 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.271344 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.271650 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.271953 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.272259 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.272563 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.272870 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.273172 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.273475 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.273781 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.274116 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.274440 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.274759 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.275065 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.275382 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.275778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.276031 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.276337 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.276675 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.276991 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.277296 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.277611 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.277948 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.278253 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.278583 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.278891 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.279207 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.279540 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.279850 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.280102 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.280400 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.280710 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.281020 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.281326 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.281630 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.281959 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.282271 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.282573 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.282875 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.283635 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.283635 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.283963 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.284119 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.284349 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.284635 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.284936 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.285252 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.285569 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.285871 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.286193 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.286497 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.286801 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.288210 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.288210 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.288512 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 09:57:27.288948 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.289049 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 09:57:27.289150 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.289150 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.289320 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 09:57:27.289405 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.289488 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 09:57:27.289577 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.289673 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 09:57:27.289758 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.289848 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.289970 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.291252 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.291365 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.291466 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.291559 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.291651 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.291736 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.291826 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.291919 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.292012 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.292107 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.292191 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.292274 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.292365 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.292461 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.292554 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.292645 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.292733 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.293041 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.293141 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.293237 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.293322 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-1-iscsi {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.293405 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.293489 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.293616 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.293715 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.293809 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.293929 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.294535 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.294535 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.294717 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.294816 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.294908 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.295078 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.295200 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.295385 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.295493 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.295701 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.295899 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.296021 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.296218 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.296373 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.296540 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.296696 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.296838 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.296988 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.297137 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.297293 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.297454 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.297628 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.297754 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.297970 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.298107 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.298284 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.298423 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.298598 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.298752 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.298925 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.299065 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.299243 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.299470 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-1-iscsi {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.299562 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.299793 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.299893 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.300107 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.300206 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.300437 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.300528 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.300772 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.300862 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.301121 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.301253 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.301404 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.301514 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.301721 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.301825 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.302057 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.302152 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.302374 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.302469 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.302699 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.302800 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.303021 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.303116 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.303334 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.303428 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.303654 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.303757 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.303961 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.304056 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.304276 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.304370 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.304589 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.304692 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.304907 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.305000 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.305215 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.305321 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.305522 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.305682 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.305829 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.306050 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.306205 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.306340 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.306486 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.306642 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.306790 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.306929 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.307067 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.307221 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.307440 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.307590 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.307737 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.307894 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.308042 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.308190 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.308342 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.308491 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.308637 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.308770 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.308867 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.308962 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.309095 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.309184 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.309312 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.309475 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.309642 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.310355 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.310620 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.310716 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.310935 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.311071 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.311249 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.311365 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.311559 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.311650 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.311863 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.311955 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.312166 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.312271 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.312470 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.312561 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.312776 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.312866 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.313077 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.313175 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.313396 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.313489 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.313714 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.313812 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.314045 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.314137 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.314378 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.314469 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.314683 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.314835 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.314995 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.315094 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.315306 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.315417 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.315612 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.315710 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.315912 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.316013 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.316216 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.316307 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.316522 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.316625 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.316826 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.316917 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.317145 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.317245 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.317400 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.317499 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.317708 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.317809 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.318045 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.318153 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.318361 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.318471 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.318664 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.318763 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.318971 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.319073 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.319282 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.319391 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.319586 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.319678 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.319893 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.319990 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.320198 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.320296 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.320505 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.320603 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.320818 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.320907 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.321125 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.321224 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.321437 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.321547 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.321745 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.321848 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.322083 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.322192 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.322392 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.322482 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.322715 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.322814 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.323027 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.323130 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.323331 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.323429 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.323636 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.323735 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.323937 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.324036 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.324240 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.324331 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.324542 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.324636 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.324850 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.324943 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.325153 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.325269 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.325481 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.325585 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.325780 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.325896 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.326113 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.326214 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.326414 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.326516 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.326731 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.326832 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.327035 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.327135 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.327338 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.327429 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.327639 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.327743 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.327939 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.328040 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.328254 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.328344 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.328563 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.328670 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.328870 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.329007 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.329183 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.329275 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.329491 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.329604 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.329798 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.329934 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.330133 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.330242 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.330441 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.330540 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.330747 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.330844 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.331049 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.331138 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.331353 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.331458 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.331662 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.331812 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.331975 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.332077 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.332280 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.332371 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.332587 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.332677 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.332901 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.332998 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:57:27.333220 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.333320 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.333530 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.333631 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.333848 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.333973 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.334181 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.334287 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.334496 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.334591 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.334832 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.334930 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.335162 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.335267 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.335477 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.335622 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.335794 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.335893 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.336101 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.336202 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.336414 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.336513 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.336719 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.336818 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.337025 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.337129 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.337331 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.337431 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.337635 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.337733 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.337977 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.338074 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.338285 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.338377 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.338602 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.338701 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.338908 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.339000 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.339229 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.339332 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.339535 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.339628 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.339848 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.339948 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.340150 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.340247 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.340459 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.340551 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.340784 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.341401 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.341653 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.341798 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.341981 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.342093 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.342288 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.342388 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.342608 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.342699 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.342919 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.343018 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.343227 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.343325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.343532 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.343630 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.343835 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.343936 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.344137 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.344227 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.344444 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.344648 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.344750 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.344900 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.345049 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.345185 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.345355 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.345446 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.345655 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.345754 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.345987 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.346082 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.346295 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.346399 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.346598 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.346691 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.346899 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.346998 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.347208 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.347299 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.347524 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.347622 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.347828 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.347978 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.348144 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.348244 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.348463 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.348555 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.348765 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.348857 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.349066 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.349166 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.349373 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.349469 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.349683 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.349780 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.350011 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.350123 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.350313 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.350413 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.350614 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.350720 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.350953 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.351053 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.351263 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.351361 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.351563 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.351653 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.351877 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.352021 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.352196 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.352287 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.352499 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.352587 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.352807 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.352906 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.353112 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.353210 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.353418 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.353509 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.353729 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.353821 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.354063 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.354166 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.354371 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.354473 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.354679 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.354773 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.354984 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.355084 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.355300 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.355401 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.355607 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.355698 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.355917 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.356012 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.356223 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.356326 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.356582 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.357214 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.357400 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.357497 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.357703 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.357805 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.358031 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.358125 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.358350 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.358442 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.358712 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.358927 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.359065 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.359266 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.359394 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.359578 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.359707 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.359897 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.359992 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.360213 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.360312 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.360532 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.360637 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.360860 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.360953 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.361185 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.361276 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.361510 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.361614 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.361818 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.361944 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.362152 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.362346 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.362482 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.362603 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.362744 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.362836 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.363052 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.363152 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.363352 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.363451 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.363653 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.363754 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.363955 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.364048 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.364261 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.364351 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.364559 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.364657 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.364860 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.364952 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.365159 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.365288 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.365458 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.365609 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.365769 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.365943 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.366093 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.366296 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.366389 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.366611 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.366716 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.366959 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.367060 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.367281 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.367370 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.367582 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.367682 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.367882 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.367974 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.368183 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.368281 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.368519 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.368612 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.368820 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.368913 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.369140 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.369232 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.369458 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.369551 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.369775 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.369874 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.370123 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.370229 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.370427 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.370519 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.370747 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.370846 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.371051 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.371158 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.371352 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.371452 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.371653 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.371755 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.371959 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.372059 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.372296 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.372449 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.372595 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.372738 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.372968 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.373184 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.373354 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.373490 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.373640 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.373781 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.373956 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.374107 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.374288 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.374414 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.374608 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.374700 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.374930 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.375022 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.375245 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.375339 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.375562 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.375657 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.375875 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.375975 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.376182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.376277 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.376485 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.376593 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.376784 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.376876 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.377088 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.377189 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.377386 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.377488 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.377697 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.377790 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.378032 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.378127 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.378334 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.378441 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.378635 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.378727 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.378940 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.379043 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.379248 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.379349 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.379546 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.379646 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.379864 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.379957 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.380170 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.380270 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.380470 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.380564 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.380770 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.380869 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.381075 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.381175 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.381375 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.381468 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.381674 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.381766 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.382006 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.382157 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.382329 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.382466 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.382640 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.382733 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.382939 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.383032 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.383244 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.383337 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.383543 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.383644 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.383841 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.383934 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.384139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.384238 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.384442 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.384553 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.384739 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.384832 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.385036 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.385128 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.385333 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.385435 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.385632 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.385727 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.385955 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.386051 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.386273 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.386417 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.386579 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.386680 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.386878 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.386983 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.387177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.387279 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.387475 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.387567 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.387837 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.387940 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.388141 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.388520 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.388702 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.388794 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.389035 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.389126 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.389353 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.389460 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.389664 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.389764 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.389992 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.390097 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.390304 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.390404 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.390614 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.390717 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.390915 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.391008 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.391228 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.391328 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.391536 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.391636 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.391847 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.391945 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.392147 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.392240 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.392449 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.392585 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.392763 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.392867 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.393068 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.393166 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.393377 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.393468 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.393688 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.393868 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.394024 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.394118 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.394336 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.394436 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.394640 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.394742 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.394946 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.395045 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.395253 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.395344 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.395556 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.395706 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.395864 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.395965 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.396170 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.396437 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.396541 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.396769 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.396861 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.397077 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.397169 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.397384 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.397485 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.397693 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.397784 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.398024 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.398119 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.398333 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.398442 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.398639 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.398730 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.398942 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.399041 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.399269 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.399370 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.399575 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.399674 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.399878 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.399979 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.400193 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.400289 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.400493 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.400579 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.400798 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.400890 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.401097 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.401196 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.401405 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.401524 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.401719 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.401819 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.402056 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.402150 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.402368 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.402472 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.402677 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.402772 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.402987 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.403079 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.403308 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.403941 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.404156 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.404250 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.404458 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.404547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.404769 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.404873 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.405097 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.405193 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.405410 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.405512 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.405736 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.405850 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.406049 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.406155 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.406360 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.406462 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.406666 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.406757 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.406995 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.407095 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.407298 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.407390 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.407599 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.407693 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.407899 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.407991 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.408219 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.408319 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.408521 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.408614 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.408839 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.408943 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.409187 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.409285 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.409496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.409600 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.409806 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.409933 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.410150 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.410304 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.410465 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.410610 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.410780 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.410883 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.411097 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.411204 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.411412 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.411513 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.411727 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.411819 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.412041 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.412142 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.412349 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.412483 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.412659 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.412752 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.412967 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.413075 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.413288 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.413379 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.413595 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.413688 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.413916 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.414022 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.414221 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.414320 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.414533 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.414624 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.414846 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.414947 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.415154 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.415254 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.415467 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.415559 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.415791 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.415931 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.416097 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.416198 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.416405 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.416504 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.416714 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.416814 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.417022 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.417113 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.417335 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.417436 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.417647 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.417746 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.417976 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.418079 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.418282 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.418392 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.418583 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.418676 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.418899 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.419080 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.419749 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.419882 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.420065 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.420167 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.420376 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.420476 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.420687 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.420833 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.420993 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.421128 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.421302 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.421408 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.421623 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.421726 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.421952 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.422048 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.422268 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.422370 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.422576 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.422677 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.422885 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.422988 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.423192 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.423297 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.423491 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.423590 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.423794 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.423884 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.424101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.424194 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.424398 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.424489 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.424700 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.424792 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.425001 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.425106 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.425323 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.425421 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.425632 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.425722 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.425958 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.426069 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.426268 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.426368 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.426576 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.426676 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.426909 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.427050 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.427221 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.427346 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.427556 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.427648 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.427872 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.427978 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.428189 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.428280 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.428512 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.428603 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.428813 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.428903 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.429115 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.429218 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.429423 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.429523 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.429730 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.429831 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.430063 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.430164 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.430374 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.430519 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.430680 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.430781 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.430982 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.431082 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.431290 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.431387 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.431588 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.431692 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.431908 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.432000 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.432210 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.432303 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.432529 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.432621 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.432874 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.432968 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.433141 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.433230 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.433444 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.433547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.433744 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.433836 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.434086 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.434180 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.434400 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.434493 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.434778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.434897 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.435121 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.435215 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.435441 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.435533 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.435760 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.435862 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.436077 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.436168 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.436391 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.436483 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.436704 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.436805 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.437014 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.437112 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.437327 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.437417 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.437638 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.437743 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.437973 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.438068 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.438290 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.438381 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.438607 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.438700 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.438914 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.439045 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.439227 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.439330 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.439535 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.439636 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.439850 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.439949 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.440160 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.440378 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.440599 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.440700 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.440925 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.441026 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.441245 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.441348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.441558 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.441651 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.441875 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.442039 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.442236 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.442336 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.442549 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.442650 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.442862 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.442967 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.443176 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.443295 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.443486 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.443587 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.443815 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.443915 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.444139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.444240 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.444464 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.444564 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.444803 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.444902 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.445111 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.445209 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.445424 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.445522 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.445738 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.445830 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.446078 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.446170 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.446389 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.446487 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.446701 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.446855 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.447031 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.447125 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.447343 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.447442 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.447657 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.447757 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.447972 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.448070 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.448282 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.448375 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.448593 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.448698 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.448905 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.449091 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.449224 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.449411 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.449503 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.449728 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.449822 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.450101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.450204 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.450461 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.450564 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.450792 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.450891 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.451103 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.451194 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.451424 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.451592 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.451733 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.451826 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.452045 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.452144 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.452360 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.452461 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.452678 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.452882 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.452999 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.453206 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.453328 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.453542 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.453691 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.453868 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.454014 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.454214 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.454323 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.454533 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.454625 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.454851 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.454991 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.455180 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.455320 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.455488 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.455636 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.455795 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.455964 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.456105 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.456297 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.456419 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.456609 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.456724 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.456918 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.457047 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.457234 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.457360 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.457544 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.457664 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.457854 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.458025 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.458215 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.458308 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.458525 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.458822 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.458915 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.459144 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.459237 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.459460 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.459564 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.459768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.459868 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.460076 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.460177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.460401 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.460508 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.460705 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.460855 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.461027 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.461119 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.461331 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.461430 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.461639 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.461741 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.461981 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.462087 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.462292 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.462383 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.462593 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.462694 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.462897 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.463027 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.463207 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.463313 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.463515 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.463627 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.463813 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.463913 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.464122 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.464217 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.464422 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.464516 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.464746 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.464839 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.465050 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.465141 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.465354 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.465454 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.465656 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.465755 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.466508 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.466641 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.466814 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.466989 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.467118 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.467318 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.467418 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.467646 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.467791 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.467979 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.468074 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.468291 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.468384 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.468598 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.468690 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.468902 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.468993 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.469208 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.469298 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.469509 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.469608 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.469814 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.469960 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.470156 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.470249 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.470466 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.470568 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.470780 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.470915 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.471084 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.471184 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.471398 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.471528 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.471707 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.471788 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.472024 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.472126 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.472337 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.472418 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.472643 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.472730 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.472952 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.473052 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.473261 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.473363 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.473614 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.473811 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.473971 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.474170 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.474271 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.474491 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.474591 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.474842 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.474974 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.475156 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.475249 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.475465 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.475557 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.475771 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.475872 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.476076 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.476168 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.476398 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.476490 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.476707 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.476811 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.477017 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.477146 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.477325 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.477432 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.477633 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.477739 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.477968 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.478065 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.478277 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.478369 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.478584 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.478695 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.478890 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.478983 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.479197 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.479297 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.479504 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.479765 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.479858 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.480103 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.480203 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.480406 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.480506 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.480719 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.480813 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.481046 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.481145 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.481365 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.481576 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.482270 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.482366 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.482588 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.482679 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.482907 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.482999 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.483215 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.483316 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.483525 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.483642 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.483838 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.483941 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.484145 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.484241 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.484460 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.484560 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.484788 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.484890 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.485100 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.485200 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.485404 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.485504 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.485744 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.485835 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.486108 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.486201 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.486444 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.486555 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.486765 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.486857 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.487073 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.487177 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.487393 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.487490 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.487712 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.487806 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.488021 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.488114 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.488337 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.488428 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.488652 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.488743 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.488970 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.489067 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.489288 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.489388 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.489607 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.489708 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.489944 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.490039 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.490264 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.490357 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.490568 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.490660 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.490870 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.490971 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.491177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.491272 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.491494 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.491594 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.491804 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.491909 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.492104 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.492204 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.492413 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.492512 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.492723 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.492974 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.493070 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.493299 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.493447 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.493602 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.493703 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.493987 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.494094 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.494231 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.494325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.494508 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.494611 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.494810 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.494939 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.495120 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.495278 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.495429 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.495592 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.495731 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.495904 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.496040 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.496223 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.496345 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.496542 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.496635 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.496855 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.496947 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.497208 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.497313 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.497531 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.497626 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.497827 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.497946 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.498184 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.498288 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.498502 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.498595 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.498812 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.499044 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.499137 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.499395 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.499490 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.499718 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.499811 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.500025 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.500117 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.500345 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.500446 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.500661 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.500753 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.500970 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.501071 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.501276 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.501371 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.501593 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.501692 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.501916 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.502024 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.502228 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.502320 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.502535 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.502627 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.502841 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.502942 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.503150 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.503250 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.503453 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.503565 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.503769 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.503868 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.504081 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.504193 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.504379 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.504485 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.504691 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.504784 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.505004 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.505096 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.505320 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.505439 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.505630 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.505735 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.506009 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.506127 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.506279 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.506371 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.506590 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.506684 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.506896 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.506994 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.507203 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.507303 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.507506 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.507596 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.507814 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.507916 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.508120 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.508221 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.508434 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.508527 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.508744 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.508836 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.509058 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.509160 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.509362 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.509459 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.509674 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.509764 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.510023 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.510136 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.510377 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.510469 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.510688 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.510778 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.510995 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.511095 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.511315 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.511416 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.511630 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.511723 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.511936 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.512036 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.512239 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.512332 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.512484 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 09:57:27.512584 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.512922 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.513502 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.514088 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.514477 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.514810 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.515148 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.515488 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.515804 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.516119 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.516431 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.516762 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.517079 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.517394 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.517712 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.518054 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.518374 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.518688 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.519004 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.519318 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.519631 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.519947 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.520262 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.520575 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.520892 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.521213 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.521560 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.521906 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.522234 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.522558 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.522880 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.523200 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.523518 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.523834 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.524151 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.524612 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.524956 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.525281 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.525595 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.526047 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.526370 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.526698 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.527026 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.527343 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.527672 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.528000 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.528319 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.529164 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.529483 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.529820 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.530196 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.530535 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.530866 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.531184 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.531496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.531808 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.532122 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.532447 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.532764 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.533073 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.533380 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.533695 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.534030 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.534343 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.534654 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.534964 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.535277 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.535584 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.535892 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.536199 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.536506 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.536814 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.537121 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.537432 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.537737 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.538069 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.538377 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.538686 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.538993 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.539329 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.539667 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.539987 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.540312 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.540628 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.540954 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.541275 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.541600 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.541948 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.542270 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.542583 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.542923 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.543239 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.543554 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.543867 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.544719 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.545036 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.545352 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.545683 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.546046 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.546360 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.546691 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.547014 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.547339 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.547662 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.547981 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.548318 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.548635 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.548949 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.549278 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.549592 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.549926 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.550252 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.550574 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.550905 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.551243 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.551558 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.551887 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.552218 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.552574 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.552894 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.553245 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.553581 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.553920 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.554241 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.554553 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:57:27.554804 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 09:57:27.572666 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO dbcounter [None req-6d2d05bc-68d0-466f-854b-cb85ac9f5c86 None None] Registered counter for database nova_api Jun 03 09:57:27.593396 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_db.sqlalchemy.engines [None req-6d2d05bc-68d0-466f-854b-cb85ac9f5c86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125066) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:57:27.599832 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writer thread running {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:57:27.615561 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO dbcounter [None req-09f8a159-3ec0-4f8b-a815-2ca4bf6b4566 None None] Registered counter for database nova_api Jun 03 09:57:27.635013 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_db.sqlalchemy.engines [None req-09f8a159-3ec0-4f8b-a815-2ca4bf6b4566 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125065) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:57:27.641723 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writer thread running {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:57:27.657171 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.context [None req-6d2d05bc-68d0-466f-854b-cb85ac9f5c86 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),17431b75-2fed-4946-b465-0bb5f71f4e56(cell1) {{(pid=125066) load_cells /opt/stack/nova/nova/context.py:464}} Jun 03 09:57:27.661281 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6d2d05bc-68d0-466f-854b-cb85ac9f5c86 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:27.662885 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6d2d05bc-68d0-466f-854b-cb85ac9f5c86 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:27.663676 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6d2d05bc-68d0-466f-854b-cb85ac9f5c86 None None] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:27.665619 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6d2d05bc-68d0-466f-854b-cb85ac9f5c86 None None] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:27.667579 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO dbcounter [None req-6d2d05bc-68d0-466f-854b-cb85ac9f5c86 None None] Registered counter for database nova_cell0 Jun 03 09:57:27.672131 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO dbcounter [None req-6d2d05bc-68d0-466f-854b-cb85ac9f5c86 None None] Registered counter for database nova_cell1 Jun 03 09:57:27.679351 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_db.sqlalchemy.engines [None req-6d2d05bc-68d0-466f-854b-cb85ac9f5c86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125066) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:57:27.681513 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_db.sqlalchemy.engines [None req-6d2d05bc-68d0-466f-854b-cb85ac9f5c86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125066) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:57:27.686514 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writer thread running {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:57:27.688972 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writer thread running {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:57:27.699694 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.context [None req-09f8a159-3ec0-4f8b-a815-2ca4bf6b4566 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),17431b75-2fed-4946-b465-0bb5f71f4e56(cell1) {{(pid=125065) load_cells /opt/stack/nova/nova/context.py:464}} Jun 03 09:57:27.704346 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-09f8a159-3ec0-4f8b-a815-2ca4bf6b4566 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:27.705959 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-09f8a159-3ec0-4f8b-a815-2ca4bf6b4566 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:27.706769 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-09f8a159-3ec0-4f8b-a815-2ca4bf6b4566 None None] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:27.708733 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-09f8a159-3ec0-4f8b-a815-2ca4bf6b4566 None None] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:27.710725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO dbcounter [None req-09f8a159-3ec0-4f8b-a815-2ca4bf6b4566 None None] Registered counter for database nova_cell0 Jun 03 09:57:27.714765 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO dbcounter [None req-09f8a159-3ec0-4f8b-a815-2ca4bf6b4566 None None] Registered counter for database nova_cell1 Jun 03 09:57:27.723988 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_db.sqlalchemy.engines [None req-09f8a159-3ec0-4f8b-a815-2ca4bf6b4566 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125065) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:57:27.726302 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_db.sqlalchemy.engines [None req-09f8a159-3ec0-4f8b-a815-2ca4bf6b4566 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125065) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:57:27.734286 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writer thread running {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:57:27.734639 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writer thread running {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:57:27.834188 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO dbcounter [None req-6d2d05bc-68d0-466f-854b-cb85ac9f5c86 None None] Registered counter for database nova_cell0 Jun 03 09:57:27.840962 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_db.sqlalchemy.engines [None req-6d2d05bc-68d0-466f-854b-cb85ac9f5c86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125066) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:57:27.846280 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writer thread running {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:57:27.883143 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO dbcounter [None req-09f8a159-3ec0-4f8b-a815-2ca4bf6b4566 None None] Registered counter for database nova_cell0 Jun 03 09:57:27.892607 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_db.sqlalchemy.engines [None req-09f8a159-3ec0-4f8b-a815-2ca4bf6b4566 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125065) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:57:27.896879 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writer thread running {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:57:28.301242 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: WARNING keystonemiddleware.auth_token [None req-6d2d05bc-68d0-466f-854b-cb85ac9f5c86 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 09:57:28.308775 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: WARNING keystonemiddleware.auth_token [None req-6d2d05bc-68d0-466f-854b-cb85ac9f5c86 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 09:57:28.344256 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: WARNING keystonemiddleware.auth_token [None req-09f8a159-3ec0-4f8b-a815-2ca4bf6b4566 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 09:57:28.351787 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: WARNING keystonemiddleware.auth_token [None req-09f8a159-3ec0-4f8b-a815-2ca4bf6b4566 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 09:57:28.542042 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: WARNING keystonemiddleware.auth_token [None req-6d2d05bc-68d0-466f-854b-cb85ac9f5c86 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 09:57:28.548382 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: WARNING keystonemiddleware.auth_token [None req-6d2d05bc-68d0-466f-854b-cb85ac9f5c86 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 09:57:28.553775 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cfeec9c9c0 pid: 125066 (default app) Jun 03 09:57:28.581003 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: WARNING keystonemiddleware.auth_token [None req-09f8a159-3ec0-4f8b-a815-2ca4bf6b4566 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 09:57:28.587130 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: WARNING keystonemiddleware.auth_token [None req-09f8a159-3ec0-4f8b-a815-2ca4bf6b4566 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 09:57:28.593132 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cfeec9c9c0 pid: 125065 (default app) Jun 03 09:58:09.536132 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_api:SELECT=3 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:09.537034 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:SELECT=3 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:09.538236 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell0:SELECT=3 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:09.539222 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell0:SELECT=3 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:10.683316 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-0bfca256-b423-4343-b734-ac9c76087faf tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] Action: 'create', calling method: .version_select at 0x7f8d31efa3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-167449244"}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:58:11.220866 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_api:SELECT=3 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:11.222476 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell0:SELECT=3 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:11.226516 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=3 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:11.234048 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell0:SELECT=3 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:12.336313 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-5471e056-c851-41f4-9687-ed831ec1f80a tempest-VolumesGetTestJSON-1263040576 tempest-VolumesGetTestJSON-1263040576-project] Action: 'create', calling method: .version_select at 0x7f8d31efa310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1476360332", "metadata": {"Type": "work"}}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:58:13.372239 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-0bfca256-b423-4343-b734-ac9c76087faf tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.845751 Jun 03 09:58:13.374157 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1154 bytes} [Fri Jun 3 09:58:09 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3850 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 03 09:58:13.397919 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-55029c4c-661a-43d0-9886-ad4f07eee8e9 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] Calling method '.version_select at 0x7f8d31dc03a0>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:13.980642 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-55029c4c-661a-43d0-9886-ad4f07eee8e9 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/c2214940-9dc1-49db-af35-661ea0278d35" status: 200 len: 344 microversion: 2.1 time: 0.596756 Jun 03 09:58:13.981722 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 2/2] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 3 09:58:13 2022] GET /compute/v2.1/os-volumes/c2214940-9dc1-49db-af35-661ea0278d35 => generated 344 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:58:14.117858 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-8c0f6dcf-125d-4ed5-a652-bb2f30165606 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2038853759", "imageRef": "0d2dd03b-4531-46f3-88da-0380e97b1bd4", "flavorRef": "452", "networks": [{"uuid": "375052ce-3f5b-447f-8bb7-eb9324c0a557"}]}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:58:14.409573 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.network.neutron [None req-8c0f6dcf-125d-4ed5-a652-bb2f30165606 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] validate_networks() for [('375052ce-3f5b-447f-8bb7-eb9324c0a557', None, None, None, None, None)] {{(pid=125066) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:58:15.010673 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-5471e056-c851-41f4-9687-ed831ec1f80a tempest-VolumesGetTestJSON-1263040576 tempest-VolumesGetTestJSON-1263040576-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.797084 Jun 03 09:58:15.011526 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1155 bytes} [Fri Jun 3 09:58:11 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3800 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 03 09:58:15.023038 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-73dbedc6-24cc-4d19-84fc-ff086212c558 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] Calling method '.version_select at 0x7f8d31dc0310>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:15.175399 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-73dbedc6-24cc-4d19-84fc-ff086212c558 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/c2214940-9dc1-49db-af35-661ea0278d35" status: 200 len: 345 microversion: 2.1 time: 0.161233 Jun 03 09:58:15.175982 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 3 09:58:15 2022] GET /compute/v2.1/os-volumes/c2214940-9dc1-49db-af35-661ea0278d35 => generated 345 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:58:15.183152 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-12a374ad-0f9c-42c9-adb9-12926b025b13 tempest-VolumesGetTestJSON-1263040576 tempest-VolumesGetTestJSON-1263040576-project] Calling method '.version_select at 0x7f8d31dc03a0>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:15.276566 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-12a374ad-0f9c-42c9-adb9-12926b025b13 tempest-VolumesGetTestJSON-1263040576 tempest-VolumesGetTestJSON-1263040576-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/956dee06-88fc-4288-a5f4-8a0a504e869c" status: 200 len: 353 microversion: 2.1 time: 0.099544 Jun 03 09:58:15.277798 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 3/5] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 3 09:58:15 2022] GET /compute/v2.1/os-volumes/956dee06-88fc-4288-a5f4-8a0a504e869c => generated 353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:58:15.286114 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-495513ea-24af-4377-90d7-8e4be08bd415 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] Action: 'create', calling method: .version_select at 0x7f8d31dc0a60>, body: {"snapshot": {"volume_id": "c2214940-9dc1-49db-af35-661ea0278d35", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-784986280"}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:58:15.704243 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-8c0f6dcf-125d-4ed5-a652-bb2f30165606 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Flavor limits 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:58:15.704665 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-8c0f6dcf-125d-4ed5-a652-bb2f30165606 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Image limits 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:58:15.705207 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-8c0f6dcf-125d-4ed5-a652-bb2f30165606 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Flavor pref 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:58:15.705688 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-8c0f6dcf-125d-4ed5-a652-bb2f30165606 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Image pref 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:58:15.706344 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-8c0f6dcf-125d-4ed5-a652-bb2f30165606 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:58:15.730590 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8c0f6dcf-125d-4ed5-a652-bb2f30165606 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:15.731264 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8c0f6dcf-125d-4ed5-a652-bb2f30165606 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:15.732189 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8c0f6dcf-125d-4ed5-a652-bb2f30165606 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:15.732871 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8c0f6dcf-125d-4ed5-a652-bb2f30165606 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:15.830172 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-8c0f6dcf-125d-4ed5-a652-bb2f30165606 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Getting quotas for project 69776fa5af0c4573b668bbf8dc200931. Resources: {'ram', 'instances', 'cores'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:58:15.859480 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-8c0f6dcf-125d-4ed5-a652-bb2f30165606 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Getting quotas for user d2ed7dd8d03c4c42925e3efca1915a46 and project 69776fa5af0c4573b668bbf8dc200931. Resources: {'ram', 'instances', 'cores'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:58:15.882859 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-8c0f6dcf-125d-4ed5-a652-bb2f30165606 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Going to run 1 instances... {{(pid=125066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:58:15.893962 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-8c0f6dcf-125d-4ed5-a652-bb2f30165606 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2dd03b-4531-46f3-88da-0380e97b1bd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:58:15.975003 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-495513ea-24af-4377-90d7-8e4be08bd415 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.695776 Jun 03 09:58:15.981316 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 4/6] 10.222.0.42 () {60 vars in 1161 bytes} [Fri Jun 3 09:58:15 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:58:15.987004 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-ef1a7e33-3961-4bf7-9800-b4ecc83b04a2 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] Calling method '.version_select at 0x7f8d31d57700>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:16.084676 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-ef1a7e33-3961-4bf7-9800-b4ecc83b04a2 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/423fc8da-e9e9-4a55-823a-63a7b68d1de1" status: 200 len: 286 microversion: 2.1 time: 0.101099 Jun 03 09:58:16.085322 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 5/7] 10.222.0.42 () {58 vars in 1250 bytes} [Fri Jun 3 09:58:15 2022] GET /compute/v2.1/os-snapshots/423fc8da-e9e9-4a55-823a-63a7b68d1de1 => generated 286 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:58:16.096275 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-6fdfe236-604e-4d44-8ae3-e96870c142a5 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] Calling method '.version_select at 0x7f8d31dc0dc0>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:16.130995 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-8c0f6dcf-125d-4ed5-a652-bb2f30165606 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.146879 Jun 03 09:58:16.157686 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 3/8] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 3 09:58:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 09:58:16.171706 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-69c5c10b-f8d7-4cea-b4d9-e85824e86d6c tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:16.175245 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-69c5c10b-f8d7-4cea-b4d9-e85824e86d6c tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:16.211538 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-6fdfe236-604e-4d44-8ae3-e96870c142a5 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.119408 Jun 03 09:58:16.213090 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 6/9] 10.222.0.42 () {58 vars in 1139 bytes} [Fri Jun 3 09:58:16 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:58:16.224336 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-af16d3f9-3bc1-4ccc-b04d-53c07960c38b tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] Calling method '.version_select at 0x7f8d31d57a60>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:16.435153 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-af16d3f9-3bc1-4ccc-b04d-53c07960c38b tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/423fc8da-e9e9-4a55-823a-63a7b68d1de1" status: 200 len: 286 microversion: 2.1 time: 0.215991 Jun 03 09:58:16.436024 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 7/10] 10.222.0.42 () {58 vars in 1250 bytes} [Fri Jun 3 09:58:16 2022] GET /compute/v2.1/os-snapshots/423fc8da-e9e9-4a55-823a-63a7b68d1de1 => generated 286 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:58:16.443432 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-b294ca2e-f880-4d0b-9245-7ea1fd1f3b3c tempest-VolumesGetTestJSON-1263040576 tempest-VolumesGetTestJSON-1263040576-project] Calling method '.version_select at 0x7f8d31d57280>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:16.605762 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-b294ca2e-f880-4d0b-9245-7ea1fd1f3b3c tempest-VolumesGetTestJSON-1263040576 tempest-VolumesGetTestJSON-1263040576-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/956dee06-88fc-4288-a5f4-8a0a504e869c" status: 200 len: 354 microversion: 2.1 time: 0.166691 Jun 03 09:58:16.645756 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 8/11] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 3 09:58:16 2022] GET /compute/v2.1/os-volumes/956dee06-88fc-4288-a5f4-8a0a504e869c => generated 354 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:58:16.653500 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-05822908-4044-4c55-a526-c40e5f758328 tempest-VolumesGetTestJSON-1263040576 tempest-VolumesGetTestJSON-1263040576-project] Calling method '.version_select at 0x7f8d31dc0280>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:16.836174 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-05822908-4044-4c55-a526-c40e5f758328 tempest-VolumesGetTestJSON-1263040576 tempest-VolumesGetTestJSON-1263040576-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/956dee06-88fc-4288-a5f4-8a0a504e869c" status: 200 len: 354 microversion: 2.1 time: 0.188776 Jun 03 09:58:16.838630 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 9/12] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 3 09:58:16 2022] GET /compute/v2.1/os-volumes/956dee06-88fc-4288-a5f4-8a0a504e869c => generated 354 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:58:16.857732 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-4b6e0d9f-1e1b-4567-8474-46b1badb831f tempest-VolumesGetTestJSON-1263040576 tempest-VolumesGetTestJSON-1263040576-project] Calling method '.version_select at 0x7f8d31dc09d0>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:16.922209 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-69c5c10b-f8d7-4cea-b4d9-e85824e86d6c tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:16.971302 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-69c5c10b-f8d7-4cea-b4d9-e85824e86d6c tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1215 microversion: 2.1 time: 0.811989 Jun 03 09:58:16.971915 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 4/13] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:16 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1215 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:17.208871 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-4b6e0d9f-1e1b-4567-8474-46b1badb831f tempest-VolumesGetTestJSON-1263040576 tempest-VolumesGetTestJSON-1263040576-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/956dee06-88fc-4288-a5f4-8a0a504e869c" status: 202 len: 0 microversion: 2.1 time: 0.356793 Jun 03 09:58:17.209442 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 10/14] 10.222.0.42 () {58 vars in 1247 bytes} [Fri Jun 3 09:58:16 2022] DELETE /compute/v2.1/os-volumes/956dee06-88fc-4288-a5f4-8a0a504e869c => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:58:17.217503 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-69f3f2f4-9d59-4d86-a9aa-506eda4d444d tempest-VolumesGetTestJSON-1263040576 tempest-VolumesGetTestJSON-1263040576-project] Calling method '.version_select at 0x7f8d314834c0>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:17.340577 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-69f3f2f4-9d59-4d86-a9aa-506eda4d444d tempest-VolumesGetTestJSON-1263040576 tempest-VolumesGetTestJSON-1263040576-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/956dee06-88fc-4288-a5f4-8a0a504e869c" status: 200 len: 353 microversion: 2.1 time: 0.126841 Jun 03 09:58:17.342055 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 5/15] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 3 09:58:17 2022] GET /compute/v2.1/os-volumes/956dee06-88fc-4288-a5f4-8a0a504e869c => generated 353 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:58:17.447263 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-a35ef8d9-762f-4b4c-80a0-5dbfbfa0ac1b tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] Calling method '.version_select at 0x7f8d31d570d0>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:17.493858 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-a35ef8d9-762f-4b4c-80a0-5dbfbfa0ac1b tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/423fc8da-e9e9-4a55-823a-63a7b68d1de1" status: 200 len: 286 microversion: 2.1 time: 0.050671 Jun 03 09:58:17.494767 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 11/16] 10.222.0.42 () {58 vars in 1250 bytes} [Fri Jun 3 09:58:17 2022] GET /compute/v2.1/os-snapshots/423fc8da-e9e9-4a55-823a-63a7b68d1de1 => generated 286 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:58:17.988559 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-acab6122-e55a-45f1-9d97-04fec7097737 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:17.989216 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-acab6122-e55a-45f1-9d97-04fec7097737 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:18.162022 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-acab6122-e55a-45f1-9d97-04fec7097737 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:18.189935 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-acab6122-e55a-45f1-9d97-04fec7097737 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1215 microversion: 2.1 time: 0.205062 Jun 03 09:58:18.199830 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 6/17] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:17 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1215 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:18.353251 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-acbd7c26-2c8d-4103-80ff-a9cee0ee3383 tempest-VolumesGetTestJSON-1263040576 tempest-VolumesGetTestJSON-1263040576-project] Calling method '.version_select at 0x7f8d31d579d0>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:18.443880 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-acbd7c26-2c8d-4103-80ff-a9cee0ee3383 tempest-VolumesGetTestJSON-1263040576 tempest-VolumesGetTestJSON-1263040576-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/956dee06-88fc-4288-a5f4-8a0a504e869c" status: 200 len: 353 microversion: 2.1 time: 0.094731 Jun 03 09:58:18.444727 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 12/18] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 3 09:58:18 2022] GET /compute/v2.1/os-volumes/956dee06-88fc-4288-a5f4-8a0a504e869c => generated 353 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:58:18.507333 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-853eb34f-211a-420f-93e0-7c2ced4a0762 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] Calling method '.version_select at 0x7f8d31492550>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:18.614964 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-853eb34f-211a-420f-93e0-7c2ced4a0762 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/423fc8da-e9e9-4a55-823a-63a7b68d1de1" status: 200 len: 286 microversion: 2.1 time: 0.112431 Jun 03 09:58:18.615728 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 7/19] 10.222.0.42 () {58 vars in 1250 bytes} [Fri Jun 3 09:58:18 2022] GET /compute/v2.1/os-snapshots/423fc8da-e9e9-4a55-823a-63a7b68d1de1 => generated 286 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:58:19.210388 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-5acca86d-02f2-42a7-abd9-945089f33fdc tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:19.211603 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-5acca86d-02f2-42a7-abd9-945089f33fdc tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:19.380103 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-5acca86d-02f2-42a7-abd9-945089f33fdc tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:19.403036 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-5acca86d-02f2-42a7-abd9-945089f33fdc tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1215 microversion: 2.1 time: 0.199310 Jun 03 09:58:19.403634 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 13/20] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:19 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1215 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:19.458848 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-50414c22-9dba-4537-8921-aa8c53400dfa tempest-VolumesGetTestJSON-1263040576 tempest-VolumesGetTestJSON-1263040576-project] Calling method '.version_select at 0x7f8d31483160>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:19.520203 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-50414c22-9dba-4537-8921-aa8c53400dfa tempest-VolumesGetTestJSON-1263040576 tempest-VolumesGetTestJSON-1263040576-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/956dee06-88fc-4288-a5f4-8a0a504e869c" status: 200 len: 353 microversion: 2.1 time: 0.067571 Jun 03 09:58:19.520775 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 8/21] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 3 09:58:19 2022] GET /compute/v2.1/os-volumes/956dee06-88fc-4288-a5f4-8a0a504e869c => generated 353 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:58:19.626168 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-6ec6378d-82dc-4667-9f26-ba696ce69407 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] Calling method '.version_select at 0x7f8d31d57550>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:19.678645 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-6ec6378d-82dc-4667-9f26-ba696ce69407 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/423fc8da-e9e9-4a55-823a-63a7b68d1de1" status: 200 len: 287 microversion: 2.1 time: 0.056446 Jun 03 09:58:19.679315 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 14/22] 10.222.0.42 () {58 vars in 1250 bytes} [Fri Jun 3 09:58:19 2022] GET /compute/v2.1/os-snapshots/423fc8da-e9e9-4a55-823a-63a7b68d1de1 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:58:19.691299 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-f09a83f5-47b5-49e6-b4f4-f2f3c7630929 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] Calling method '.version_select at 0x7f8d30c1b3a0>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:19.956512 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-f09a83f5-47b5-49e6-b4f4-f2f3c7630929 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/423fc8da-e9e9-4a55-823a-63a7b68d1de1" status: 202 len: 0 microversion: 2.1 time: 0.269892 Jun 03 09:58:19.957550 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 9/23] 10.222.0.42 () {58 vars in 1253 bytes} [Fri Jun 3 09:58:19 2022] DELETE /compute/v2.1/os-snapshots/423fc8da-e9e9-4a55-823a-63a7b68d1de1 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:58:19.968125 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-70378a22-ba2b-4ef2-85a5-b7a80b014f65 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] Calling method '.version_select at 0x7f8d31d33280>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:20.020942 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-70378a22-ba2b-4ef2-85a5-b7a80b014f65 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/423fc8da-e9e9-4a55-823a-63a7b68d1de1" status: 200 len: 286 microversion: 2.1 time: 0.058338 Jun 03 09:58:20.021824 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 15/24] 10.222.0.42 () {58 vars in 1250 bytes} [Fri Jun 3 09:58:19 2022] GET /compute/v2.1/os-snapshots/423fc8da-e9e9-4a55-823a-63a7b68d1de1 => generated 286 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:58:20.420521 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-7277e0cc-2a39-4ee6-8ee5-ea3836eca54b tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:20.421082 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-7277e0cc-2a39-4ee6-8ee5-ea3836eca54b tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:20.432149 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7277e0cc-2a39-4ee6-8ee5-ea3836eca54b tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:20.432760 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7277e0cc-2a39-4ee6-8ee5-ea3836eca54b tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:20.434025 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7277e0cc-2a39-4ee6-8ee5-ea3836eca54b tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:20.434472 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7277e0cc-2a39-4ee6-8ee5-ea3836eca54b tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:20.535523 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-596b4b69-017f-4bc3-b846-040c2908211f tempest-VolumesGetTestJSON-1263040576 tempest-VolumesGetTestJSON-1263040576-project] Calling method '.version_select at 0x7f8d31d33940>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:20.593754 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.wsgi [None req-596b4b69-017f-4bc3-b846-040c2908211f tempest-VolumesGetTestJSON-1263040576 tempest-VolumesGetTestJSON-1263040576-project] HTTP exception thrown: Volume 956dee06-88fc-4288-a5f4-8a0a504e869c could not be found. Jun 03 09:58:20.598253 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-596b4b69-017f-4bc3-b846-040c2908211f tempest-VolumesGetTestJSON-1263040576 tempest-VolumesGetTestJSON-1263040576-project] Request method failure captured: Jun 03 09:58:20.598253 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: request: GET /compute/v2.1/os-volumes/956dee06-88fc-4288-a5f4-8a0a504e869c HTTP/1.1 Jun 03 09:58:20.598253 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept: application/json Jun 03 09:58:20.598253 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept-Encoding: identity Jun 03 09:58:20.598253 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Connection: close Jun 03 09:58:20.598253 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Length: 0 Jun 03 09:58:20.598253 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Type: application/json Jun 03 09:58:20.598253 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Host: 10.222.0.42 Jun 03 09:58:20.598253 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Openstack-System-Scope: None Jun 03 09:58:20.598253 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: User-Agent: python-urllib3/1.26.9 Jun 03 09:58:20.598253 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Auth-Token: gAAAAABimdszmYywCgFSEAL3ud2NhvjUaZKPL7sQN6GX6mlVMh2XnGK446LBUyn511jkpGE4NpP66ta17prRf-9yBz1M0urNSe8pAvM-fKqjQ8ALnP4MExY9X3BtuJqC8XXvFf9ZY1tI6DtNt6hu3MK9c4Xfl5Royfsxii_BDwq4yV0bhxwei5c Jun 03 09:58:20.598253 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Id: None Jun 03 09:58:20.598253 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Name: None Jun 03 09:58:20.598253 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Identity-Status: Confirmed Jun 03 09:58:20.598253 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Is-Admin-Project: True Jun 03 09:58:20.598253 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Id: default Jun 03 09:58:20.598253 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Name: Default Jun 03 09:58:20.598253 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Id: b6522d9aaf5a45b2910df87d13a0b30d Jun 03 09:58:20.598253 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Name: tempest-VolumesGetTestJSON-1263040576 Jun 03 09:58:20.598253 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Role: member,reader Jun 03 09:58:20.598253 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Roles: member,reader Jun 03 09:58:20.608218 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b6522d9aaf5a45b2910df87d13a0b30d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6522d9aaf5a45b2910df87d13a0b30d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b6522d9aaf5a45b2910df87d13a0b30d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b6522d9aaf5a45b2910df87d13a0b30d"}]}] Jun 03 09:58:20.608218 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant: tempest-VolumesGetTestJSON-1263040576 Jun 03 09:58:20.608218 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Id: b6522d9aaf5a45b2910df87d13a0b30d Jun 03 09:58:20.608218 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Name: tempest-VolumesGetTestJSON-1263040576 Jun 03 09:58:20.608218 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User: tempest-VolumesGetTestJSON-1263040576-project Jun 03 09:58:20.608218 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Id: default Jun 03 09:58:20.608218 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Name: Default Jun 03 09:58:20.608218 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Id: 7031f44ed4c64aa8b8e236cb8e3c1b9e Jun 03 09:58:20.608218 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Name: tempest-VolumesGetTestJSON-1263040576-project Jun 03 09:58:20.608218 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: method: Jun 03 09:58:20.608218 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: exception: Volume 956dee06-88fc-4288-a5f4-8a0a504e869c could not be found. Jun 03 09:58:20.608218 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: action_args: {'id': '956dee06-88fc-4288-a5f4-8a0a504e869c'} Jun 03 09:58:20.608218 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:58:20.610625 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:20.610625 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:58:20.610625 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:58:20.610625 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 09:58:20.610625 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 09:58:20.610625 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 09:58:20.610625 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 09:58:20.610625 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 09:58:20.610625 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 09:58:20.610625 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 09:58:20.610625 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 09:58:20.610625 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:58:20.610625 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:58:20.610625 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:58:20.610625 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:58:20.610625 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 956dee06-88fc-4288-a5f4-8a0a504e869c could not be found. (HTTP 404) (Request-ID: req-e1c606b4-2403-4444-98e1-72d1da56483a) Jun 03 09:58:20.610625 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:20.610625 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:20.610625 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:20.611725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:20.611725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 03 09:58:20.611725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 03 09:58:20.611725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 09:58:20.611725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 09:58:20.611725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 09:58:20.611725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 09:58:20.611725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 09:58:20.611725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 09:58:20.611725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:58:20.611725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:58:20.611725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 09:58:20.611725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 09:58:20.611725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 09:58:20.611725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 09:58:20.611725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 09:58:20.611725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 09:58:20.611725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 09:58:20.611725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 09:58:20.612866 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:58:20.612866 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:58:20.612866 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:58:20.612866 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:58:20.612866 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 956dee06-88fc-4288-a5f4-8a0a504e869c could not be found. Jun 03 09:58:20.612866 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:20.612866 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:20.612866 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:20.612866 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:20.612866 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:58:20.612866 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:58:20.612866 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:58:20.612866 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:58:20.612866 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 09:58:20.612866 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 09:58:20.612866 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:58:20.612866 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:58:20.612866 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 03 09:58:20.612866 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:58:20.613982 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 956dee06-88fc-4288-a5f4-8a0a504e869c could not be found. Jun 03 09:58:20.613982 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:20.613982 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:20.613982 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:20.613982 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:20.613982 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:58:20.613982 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:58:20.613982 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:58:20.613982 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:58:20.613982 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 956dee06-88fc-4288-a5f4-8a0a504e869c could not be found. Jun 03 09:58:20.613982 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:20.613982 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-596b4b69-017f-4bc3-b846-040c2908211f tempest-VolumesGetTestJSON-1263040576 tempest-VolumesGetTestJSON-1263040576-project] Returning 404 to user: Volume 956dee06-88fc-4288-a5f4-8a0a504e869c could not be found. {{(pid=125065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:58:20.613982 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-596b4b69-017f-4bc3-b846-040c2908211f tempest-VolumesGetTestJSON-1263040576 tempest-VolumesGetTestJSON-1263040576-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/956dee06-88fc-4288-a5f4-8a0a504e869c" status: 404 len: 109 microversion: 2.1 time: 0.069486 Jun 03 09:58:20.613982 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 16/25] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 3 09:58:20 2022] GET /compute/v2.1/os-volumes/956dee06-88fc-4288-a5f4-8a0a504e869c => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:58:21.034779 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-e1140575-d733-47f3-bb72-36e96ecca82e tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] Calling method '.version_select at 0x7f8d31c99310>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:21.055555 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-7277e0cc-2a39-4ee6-8ee5-ea3836eca54b tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:21.108510 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-7277e0cc-2a39-4ee6-8ee5-ea3836eca54b tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1267 microversion: 2.1 time: 0.692114 Jun 03 09:58:21.141334 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 10/26] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:20 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1267 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:21.170503 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.wsgi [None req-e1140575-d733-47f3-bb72-36e96ecca82e tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] HTTP exception thrown: Snapshot 423fc8da-e9e9-4a55-823a-63a7b68d1de1 could not be found. Jun 03 09:58:21.173796 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-e1140575-d733-47f3-bb72-36e96ecca82e tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] Request method failure captured: Jun 03 09:58:21.173796 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: request: GET /compute/v2.1/os-snapshots/423fc8da-e9e9-4a55-823a-63a7b68d1de1 HTTP/1.1 Jun 03 09:58:21.173796 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept: application/json Jun 03 09:58:21.173796 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept-Encoding: identity Jun 03 09:58:21.173796 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Connection: close Jun 03 09:58:21.173796 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Length: 0 Jun 03 09:58:21.173796 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Type: application/json Jun 03 09:58:21.173796 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Host: 10.222.0.42 Jun 03 09:58:21.173796 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Openstack-System-Scope: None Jun 03 09:58:21.173796 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: User-Agent: python-urllib3/1.26.9 Jun 03 09:58:21.173796 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Auth-Token: gAAAAABimdsxFD0u_PFEXkDgrFxl9q7iX1rvC-4ttZGtipw1SLHEkvHCmqHO4i9YxoAQQqBFFeN7RSari3kp6WKBhcu6l8MzjvFsigRmYzDVwzekycocixmZDo6r5twBEmiPoksSREZR7c_FEabDFcbDvRAE_froR1Tr8RhVNkLBU9CqWYmtFK8 Jun 03 09:58:21.173796 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Id: None Jun 03 09:58:21.173796 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Name: None Jun 03 09:58:21.173796 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Identity-Status: Confirmed Jun 03 09:58:21.173796 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Is-Admin-Project: True Jun 03 09:58:21.173796 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Id: default Jun 03 09:58:21.173796 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Name: Default Jun 03 09:58:21.173796 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Id: 2887f7ffd32547458585734b104e66b5 Jun 03 09:58:21.173796 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-344529397 Jun 03 09:58:21.173796 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Role: member,reader Jun 03 09:58:21.173796 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Roles: member,reader Jun 03 09:58:21.174848 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2887f7ffd32547458585734b104e66b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2887f7ffd32547458585734b104e66b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2887f7ffd32547458585734b104e66b5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2887f7ffd32547458585734b104e66b5"}]}] Jun 03 09:58:21.174848 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant: tempest-VolumesSnapshotsTestJSON-344529397 Jun 03 09:58:21.174848 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Id: 2887f7ffd32547458585734b104e66b5 Jun 03 09:58:21.174848 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-344529397 Jun 03 09:58:21.174848 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User: tempest-VolumesSnapshotsTestJSON-344529397-project Jun 03 09:58:21.174848 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Id: default Jun 03 09:58:21.174848 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Name: Default Jun 03 09:58:21.174848 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Id: a455c6862ccb4a988fd2ab6de3195cac Jun 03 09:58:21.174848 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Name: tempest-VolumesSnapshotsTestJSON-344529397-project Jun 03 09:58:21.174848 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: method: Jun 03 09:58:21.174848 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: exception: Snapshot 423fc8da-e9e9-4a55-823a-63a7b68d1de1 could not be found. Jun 03 09:58:21.174848 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: action_args: {'id': '423fc8da-e9e9-4a55-823a-63a7b68d1de1'} Jun 03 09:58:21.174848 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:58:21.175654 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:21.175654 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 03 09:58:21.175654 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 03 09:58:21.175654 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 03 09:58:21.175654 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 03 09:58:21.175654 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 03 09:58:21.175654 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 03 09:58:21.175654 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 09:58:21.175654 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 09:58:21.175654 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 09:58:21.175654 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 09:58:21.175654 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:58:21.175654 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:58:21.175654 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:58:21.175654 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:58:21.175654 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 423fc8da-e9e9-4a55-823a-63a7b68d1de1 could not be found. (HTTP 404) (Request-ID: req-473c8905-1089-473c-9803-871bb8178577) Jun 03 09:58:21.175654 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:21.175654 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:21.176534 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:21.176534 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:21.176534 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 03 09:58:21.176534 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 03 09:58:21.176534 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 09:58:21.176534 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 09:58:21.176534 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 03 09:58:21.176534 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 03 09:58:21.176534 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 09:58:21.176534 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 09:58:21.176534 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 03 09:58:21.176534 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 03 09:58:21.176534 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 03 09:58:21.176534 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 03 09:58:21.176534 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 03 09:58:21.176534 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 03 09:58:21.176534 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 09:58:21.176534 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 09:58:21.176534 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 09:58:21.177420 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 09:58:21.177420 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:58:21.177420 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:58:21.177420 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:58:21.177420 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:58:21.177420 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 423fc8da-e9e9-4a55-823a-63a7b68d1de1 could not be found. Jun 03 09:58:21.177420 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:21.177420 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:21.177420 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:21.177420 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:21.177420 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:58:21.177420 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:58:21.177420 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:58:21.177420 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:58:21.177420 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 09:58:21.177420 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 09:58:21.177420 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:58:21.177420 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:58:21.177420 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 03 09:58:21.177420 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:58:21.178319 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 423fc8da-e9e9-4a55-823a-63a7b68d1de1 could not be found. Jun 03 09:58:21.178319 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:21.178319 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:21.178319 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:21.178319 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:21.178319 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:58:21.178319 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:58:21.178319 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:58:21.178319 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:58:21.178319 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 423fc8da-e9e9-4a55-823a-63a7b68d1de1 could not be found. Jun 03 09:58:21.178319 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:21.181515 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-e1140575-d733-47f3-bb72-36e96ecca82e tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] Returning 404 to user: Snapshot 423fc8da-e9e9-4a55-823a-63a7b68d1de1 could not be found. {{(pid=125065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:58:21.182641 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-e1140575-d733-47f3-bb72-36e96ecca82e tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/423fc8da-e9e9-4a55-823a-63a7b68d1de1" status: 404 len: 111 microversion: 2.1 time: 0.152549 Jun 03 09:58:21.185445 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 17/27] 10.222.0.42 () {58 vars in 1250 bytes} [Fri Jun 3 09:58:21 2022] GET /compute/v2.1/os-snapshots/423fc8da-e9e9-4a55-823a-63a7b68d1de1 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:58:21.200738 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-ad336343-6908-4b89-bfb3-74b71b16371f tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] Calling method '.version_select at 0x7f8d30b9a940>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:21.479649 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-ad336343-6908-4b89-bfb3-74b71b16371f tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/c2214940-9dc1-49db-af35-661ea0278d35" status: 202 len: 0 microversion: 2.1 time: 0.289679 Jun 03 09:58:21.480576 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 11/28] 10.222.0.42 () {58 vars in 1247 bytes} [Fri Jun 3 09:58:21 2022] DELETE /compute/v2.1/os-volumes/c2214940-9dc1-49db-af35-661ea0278d35 => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:58:21.489633 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-e2a424ee-a4dd-4cf3-aa70-c28e8743d8a8 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] Calling method '.version_select at 0x7f8d31c993a0>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:21.632566 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-e2a424ee-a4dd-4cf3-aa70-c28e8743d8a8 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/c2214940-9dc1-49db-af35-661ea0278d35" status: 200 len: 344 microversion: 2.1 time: 0.145379 Jun 03 09:58:21.633439 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 18/29] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 3 09:58:21 2022] GET /compute/v2.1/os-volumes/c2214940-9dc1-49db-af35-661ea0278d35 => generated 344 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:58:22.168284 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-2d87ae4a-d8bf-4b72-963f-e36d1cd4ada2 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:22.168284 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-2d87ae4a-d8bf-4b72-963f-e36d1cd4ada2 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:22.214441 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2d87ae4a-d8bf-4b72-963f-e36d1cd4ada2 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:22.218157 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2d87ae4a-d8bf-4b72-963f-e36d1cd4ada2 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:22.223623 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2d87ae4a-d8bf-4b72-963f-e36d1cd4ada2 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:22.227764 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2d87ae4a-d8bf-4b72-963f-e36d1cd4ada2 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:22.432054 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-2d87ae4a-d8bf-4b72-963f-e36d1cd4ada2 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:22.471083 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-2d87ae4a-d8bf-4b72-963f-e36d1cd4ada2 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1273 microversion: 2.1 time: 0.306713 Jun 03 09:58:22.471083 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 12/30] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:22 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1273 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:22.644762 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-e3377176-a61c-4a23-bd04-db02d0d7a762 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] Calling method '.version_select at 0x7f8d31c99ca0>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:22.696086 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.wsgi [None req-e3377176-a61c-4a23-bd04-db02d0d7a762 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] HTTP exception thrown: Volume c2214940-9dc1-49db-af35-661ea0278d35 could not be found. Jun 03 09:58:22.705873 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-e3377176-a61c-4a23-bd04-db02d0d7a762 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] Request method failure captured: Jun 03 09:58:22.705873 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: request: GET /compute/v2.1/os-volumes/c2214940-9dc1-49db-af35-661ea0278d35 HTTP/1.1 Jun 03 09:58:22.705873 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept: application/json Jun 03 09:58:22.705873 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept-Encoding: identity Jun 03 09:58:22.705873 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Connection: close Jun 03 09:58:22.705873 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Length: 0 Jun 03 09:58:22.705873 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Type: application/json Jun 03 09:58:22.705873 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Host: 10.222.0.42 Jun 03 09:58:22.705873 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Openstack-System-Scope: None Jun 03 09:58:22.705873 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: User-Agent: python-urllib3/1.26.9 Jun 03 09:58:22.705873 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Auth-Token: gAAAAABimdsxFD0u_PFEXkDgrFxl9q7iX1rvC-4ttZGtipw1SLHEkvHCmqHO4i9YxoAQQqBFFeN7RSari3kp6WKBhcu6l8MzjvFsigRmYzDVwzekycocixmZDo6r5twBEmiPoksSREZR7c_FEabDFcbDvRAE_froR1Tr8RhVNkLBU9CqWYmtFK8 Jun 03 09:58:22.705873 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Id: None Jun 03 09:58:22.705873 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Name: None Jun 03 09:58:22.705873 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Identity-Status: Confirmed Jun 03 09:58:22.705873 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Is-Admin-Project: True Jun 03 09:58:22.705873 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Id: default Jun 03 09:58:22.705873 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Name: Default Jun 03 09:58:22.705873 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Id: 2887f7ffd32547458585734b104e66b5 Jun 03 09:58:22.705873 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-344529397 Jun 03 09:58:22.705873 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Role: member,reader Jun 03 09:58:22.705873 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Roles: member,reader Jun 03 09:58:22.707185 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2887f7ffd32547458585734b104e66b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2887f7ffd32547458585734b104e66b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2887f7ffd32547458585734b104e66b5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2887f7ffd32547458585734b104e66b5"}]}] Jun 03 09:58:22.707185 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant: tempest-VolumesSnapshotsTestJSON-344529397 Jun 03 09:58:22.707185 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Id: 2887f7ffd32547458585734b104e66b5 Jun 03 09:58:22.707185 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-344529397 Jun 03 09:58:22.707185 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User: tempest-VolumesSnapshotsTestJSON-344529397-project Jun 03 09:58:22.707185 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Id: default Jun 03 09:58:22.707185 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Name: Default Jun 03 09:58:22.707185 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Id: a455c6862ccb4a988fd2ab6de3195cac Jun 03 09:58:22.707185 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Name: tempest-VolumesSnapshotsTestJSON-344529397-project Jun 03 09:58:22.707185 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: method: Jun 03 09:58:22.707185 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: exception: Volume c2214940-9dc1-49db-af35-661ea0278d35 could not be found. Jun 03 09:58:22.707185 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: action_args: {'id': 'c2214940-9dc1-49db-af35-661ea0278d35'} Jun 03 09:58:22.707185 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:58:22.707815 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:22.707815 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:58:22.707815 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:58:22.707815 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 09:58:22.707815 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 09:58:22.707815 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 09:58:22.707815 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 09:58:22.707815 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 09:58:22.707815 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 09:58:22.707815 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 09:58:22.707815 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 09:58:22.707815 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:58:22.707815 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:58:22.707815 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:58:22.707815 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:58:22.707815 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c2214940-9dc1-49db-af35-661ea0278d35 could not be found. (HTTP 404) (Request-ID: req-bf95ad4c-42a8-4b44-ae43-f186c1f5ea32) Jun 03 09:58:22.707815 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:22.707815 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:22.707815 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:22.708725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:22.708725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 03 09:58:22.708725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 03 09:58:22.708725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 09:58:22.708725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 09:58:22.708725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 09:58:22.708725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 09:58:22.708725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 09:58:22.708725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 09:58:22.708725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:58:22.708725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:58:22.708725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 09:58:22.708725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 09:58:22.708725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 09:58:22.708725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 09:58:22.708725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 09:58:22.708725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 09:58:22.708725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 09:58:22.708725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 09:58:22.709586 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:58:22.709586 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:58:22.709586 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:58:22.709586 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:58:22.709586 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c2214940-9dc1-49db-af35-661ea0278d35 could not be found. Jun 03 09:58:22.709586 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:22.709586 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:22.709586 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:22.709586 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:22.709586 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:58:22.709586 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:58:22.709586 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:58:22.709586 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:58:22.709586 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 09:58:22.709586 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 09:58:22.709586 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:58:22.709586 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:58:22.709586 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 03 09:58:22.709586 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:58:22.711325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c2214940-9dc1-49db-af35-661ea0278d35 could not be found. Jun 03 09:58:22.711325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:22.711325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:22.711325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:22.711325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:22.711325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:58:22.711325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:58:22.711325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:58:22.711325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:58:22.711325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c2214940-9dc1-49db-af35-661ea0278d35 could not be found. Jun 03 09:58:22.711325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:22.711325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-e3377176-a61c-4a23-bd04-db02d0d7a762 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] Returning 404 to user: Volume c2214940-9dc1-49db-af35-661ea0278d35 could not be found. {{(pid=125065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:58:22.711325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-e3377176-a61c-4a23-bd04-db02d0d7a762 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/c2214940-9dc1-49db-af35-661ea0278d35" status: 404 len: 109 microversion: 2.1 time: 0.059675 Jun 03 09:58:22.711325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 19/31] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 3 09:58:22 2022] GET /compute/v2.1/os-volumes/c2214940-9dc1-49db-af35-661ea0278d35 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:58:22.723408 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-35d6a050-bb3c-49a9-81ad-2a1c5098c441 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] Calling method '.version_select at 0x7f8d30bc7e50>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:22.784495 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.wsgi [None req-35d6a050-bb3c-49a9-81ad-2a1c5098c441 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] HTTP exception thrown: Volume c2214940-9dc1-49db-af35-661ea0278d35 could not be found. Jun 03 09:58:22.788592 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-35d6a050-bb3c-49a9-81ad-2a1c5098c441 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] Request method failure captured: Jun 03 09:58:22.788592 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: request: DELETE /compute/v2.1/os-volumes/c2214940-9dc1-49db-af35-661ea0278d35 HTTP/1.1 Jun 03 09:58:22.788592 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept: application/json Jun 03 09:58:22.788592 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept-Encoding: identity Jun 03 09:58:22.788592 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Connection: close Jun 03 09:58:22.788592 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Length: 0 Jun 03 09:58:22.788592 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Type: application/json Jun 03 09:58:22.788592 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Host: 10.222.0.42 Jun 03 09:58:22.788592 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Openstack-System-Scope: None Jun 03 09:58:22.788592 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: User-Agent: python-urllib3/1.26.9 Jun 03 09:58:22.788592 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Auth-Token: gAAAAABimdsxFD0u_PFEXkDgrFxl9q7iX1rvC-4ttZGtipw1SLHEkvHCmqHO4i9YxoAQQqBFFeN7RSari3kp6WKBhcu6l8MzjvFsigRmYzDVwzekycocixmZDo6r5twBEmiPoksSREZR7c_FEabDFcbDvRAE_froR1Tr8RhVNkLBU9CqWYmtFK8 Jun 03 09:58:22.788592 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Id: None Jun 03 09:58:22.788592 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Name: None Jun 03 09:58:22.788592 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Identity-Status: Confirmed Jun 03 09:58:22.788592 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Is-Admin-Project: True Jun 03 09:58:22.788592 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Id: default Jun 03 09:58:22.788592 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Name: Default Jun 03 09:58:22.788592 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Id: 2887f7ffd32547458585734b104e66b5 Jun 03 09:58:22.788592 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-344529397 Jun 03 09:58:22.788592 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Role: member,reader Jun 03 09:58:22.788592 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Roles: member,reader Jun 03 09:58:22.792252 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2887f7ffd32547458585734b104e66b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2887f7ffd32547458585734b104e66b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2887f7ffd32547458585734b104e66b5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2887f7ffd32547458585734b104e66b5"}]}] Jun 03 09:58:22.792252 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant: tempest-VolumesSnapshotsTestJSON-344529397 Jun 03 09:58:22.792252 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Id: 2887f7ffd32547458585734b104e66b5 Jun 03 09:58:22.792252 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-344529397 Jun 03 09:58:22.792252 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User: tempest-VolumesSnapshotsTestJSON-344529397-project Jun 03 09:58:22.792252 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Id: default Jun 03 09:58:22.792252 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Name: Default Jun 03 09:58:22.792252 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Id: a455c6862ccb4a988fd2ab6de3195cac Jun 03 09:58:22.792252 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Name: tempest-VolumesSnapshotsTestJSON-344529397-project Jun 03 09:58:22.792252 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: method: Jun 03 09:58:22.792252 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: exception: Volume c2214940-9dc1-49db-af35-661ea0278d35 could not be found. Jun 03 09:58:22.792252 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: action_args: {'id': 'c2214940-9dc1-49db-af35-661ea0278d35'} Jun 03 09:58:22.792252 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:58:22.793471 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:22.793471 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:58:22.793471 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:58:22.793471 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 09:58:22.793471 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 09:58:22.793471 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 09:58:22.793471 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 09:58:22.793471 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 09:58:22.793471 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 09:58:22.793471 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 09:58:22.793471 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 09:58:22.793471 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:58:22.793471 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:58:22.793471 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:58:22.793471 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:58:22.793471 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c2214940-9dc1-49db-af35-661ea0278d35 could not be found. (HTTP 404) (Request-ID: req-a6cd4428-8944-4460-bb57-2291c119cf71) Jun 03 09:58:22.793471 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:22.793471 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:22.793471 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:22.794348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:22.794348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 03 09:58:22.794348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 03 09:58:22.794348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 09:58:22.794348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 09:58:22.794348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 09:58:22.794348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 09:58:22.794348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 09:58:22.794348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 09:58:22.794348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:58:22.794348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:58:22.794348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 09:58:22.794348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 09:58:22.794348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 09:58:22.794348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 09:58:22.794348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 09:58:22.794348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 09:58:22.794348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 09:58:22.794348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 09:58:22.795234 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:58:22.795234 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:58:22.795234 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:58:22.795234 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:58:22.795234 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c2214940-9dc1-49db-af35-661ea0278d35 could not be found. Jun 03 09:58:22.795234 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:22.795234 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:22.795234 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:22.795234 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:22.795234 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:58:22.795234 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:58:22.795234 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:58:22.795234 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:58:22.795234 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 09:58:22.795234 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 09:58:22.795234 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:58:22.795234 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:58:22.795234 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 03 09:58:22.795234 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:58:22.796064 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c2214940-9dc1-49db-af35-661ea0278d35 could not be found. Jun 03 09:58:22.796064 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:22.796064 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:22.796064 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:22.796064 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:22.796064 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:58:22.796064 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:58:22.796064 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:58:22.796064 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:58:22.796064 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c2214940-9dc1-49db-af35-661ea0278d35 could not be found. Jun 03 09:58:22.796064 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:22.796064 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-35d6a050-bb3c-49a9-81ad-2a1c5098c441 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] Returning 404 to user: Volume c2214940-9dc1-49db-af35-661ea0278d35 could not be found. {{(pid=125066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:58:22.796064 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-35d6a050-bb3c-49a9-81ad-2a1c5098c441 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/c2214940-9dc1-49db-af35-661ea0278d35" status: 404 len: 109 microversion: 2.1 time: 0.084118 Jun 03 09:58:22.801936 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 13/32] 10.222.0.42 () {58 vars in 1247 bytes} [Fri Jun 3 09:58:22 2022] DELETE /compute/v2.1/os-volumes/c2214940-9dc1-49db-af35-661ea0278d35 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:58:22.809037 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-0faa462d-5f1b-494c-8390-735f4cdb9b88 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] Calling method '.version_select at 0x7f8d31c99670>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:22.862077 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.wsgi [None req-0faa462d-5f1b-494c-8390-735f4cdb9b88 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] HTTP exception thrown: Volume c2214940-9dc1-49db-af35-661ea0278d35 could not be found. Jun 03 09:58:22.863973 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-0faa462d-5f1b-494c-8390-735f4cdb9b88 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] Request method failure captured: Jun 03 09:58:22.863973 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: request: GET /compute/v2.1/os-volumes/c2214940-9dc1-49db-af35-661ea0278d35 HTTP/1.1 Jun 03 09:58:22.863973 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept: application/json Jun 03 09:58:22.863973 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept-Encoding: identity Jun 03 09:58:22.863973 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Connection: close Jun 03 09:58:22.863973 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Length: 0 Jun 03 09:58:22.863973 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Type: application/json Jun 03 09:58:22.863973 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Host: 10.222.0.42 Jun 03 09:58:22.863973 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Openstack-System-Scope: None Jun 03 09:58:22.863973 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: User-Agent: python-urllib3/1.26.9 Jun 03 09:58:22.863973 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Auth-Token: gAAAAABimdsxFD0u_PFEXkDgrFxl9q7iX1rvC-4ttZGtipw1SLHEkvHCmqHO4i9YxoAQQqBFFeN7RSari3kp6WKBhcu6l8MzjvFsigRmYzDVwzekycocixmZDo6r5twBEmiPoksSREZR7c_FEabDFcbDvRAE_froR1Tr8RhVNkLBU9CqWYmtFK8 Jun 03 09:58:22.863973 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Id: None Jun 03 09:58:22.863973 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Name: None Jun 03 09:58:22.863973 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Identity-Status: Confirmed Jun 03 09:58:22.863973 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Is-Admin-Project: True Jun 03 09:58:22.863973 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Id: default Jun 03 09:58:22.863973 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Name: Default Jun 03 09:58:22.863973 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Id: 2887f7ffd32547458585734b104e66b5 Jun 03 09:58:22.863973 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-344529397 Jun 03 09:58:22.863973 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Role: member,reader Jun 03 09:58:22.863973 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Roles: member,reader Jun 03 09:58:22.864975 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2887f7ffd32547458585734b104e66b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2887f7ffd32547458585734b104e66b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2887f7ffd32547458585734b104e66b5", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2887f7ffd32547458585734b104e66b5"}]}] Jun 03 09:58:22.864975 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant: tempest-VolumesSnapshotsTestJSON-344529397 Jun 03 09:58:22.864975 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Id: 2887f7ffd32547458585734b104e66b5 Jun 03 09:58:22.864975 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-344529397 Jun 03 09:58:22.864975 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User: tempest-VolumesSnapshotsTestJSON-344529397-project Jun 03 09:58:22.864975 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Id: default Jun 03 09:58:22.864975 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Name: Default Jun 03 09:58:22.864975 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Id: a455c6862ccb4a988fd2ab6de3195cac Jun 03 09:58:22.864975 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Name: tempest-VolumesSnapshotsTestJSON-344529397-project Jun 03 09:58:22.864975 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: method: Jun 03 09:58:22.864975 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: exception: Volume c2214940-9dc1-49db-af35-661ea0278d35 could not be found. Jun 03 09:58:22.864975 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: action_args: {'id': 'c2214940-9dc1-49db-af35-661ea0278d35'} Jun 03 09:58:22.864975 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:58:22.865575 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:22.865575 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:58:22.865575 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:58:22.865575 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 09:58:22.865575 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 09:58:22.865575 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 09:58:22.865575 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 09:58:22.865575 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 09:58:22.865575 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 09:58:22.865575 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 09:58:22.865575 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 09:58:22.865575 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:58:22.865575 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:58:22.865575 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:58:22.865575 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:58:22.865575 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c2214940-9dc1-49db-af35-661ea0278d35 could not be found. (HTTP 404) (Request-ID: req-25b84b5f-4758-47ee-83a9-c69958f5ef19) Jun 03 09:58:22.865575 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:22.865575 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:22.865575 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:22.866547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:22.866547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 03 09:58:22.866547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 03 09:58:22.866547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 09:58:22.866547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 09:58:22.866547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 09:58:22.866547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 09:58:22.866547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 09:58:22.866547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 09:58:22.866547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:58:22.866547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:58:22.866547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 09:58:22.866547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 09:58:22.866547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 09:58:22.866547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 09:58:22.866547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 09:58:22.866547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 09:58:22.866547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 09:58:22.866547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 09:58:22.867392 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:58:22.867392 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:58:22.867392 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:58:22.867392 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:58:22.867392 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c2214940-9dc1-49db-af35-661ea0278d35 could not be found. Jun 03 09:58:22.867392 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:22.867392 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:22.867392 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:22.867392 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:22.867392 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:58:22.867392 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:58:22.867392 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:58:22.867392 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:58:22.867392 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 09:58:22.867392 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 09:58:22.867392 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:58:22.867392 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:58:22.867392 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 03 09:58:22.867392 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:58:22.868234 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c2214940-9dc1-49db-af35-661ea0278d35 could not be found. Jun 03 09:58:22.868234 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:22.868234 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:22.868234 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:22.868234 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:22.868234 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:58:22.868234 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:58:22.868234 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:58:22.868234 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:58:22.868234 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c2214940-9dc1-49db-af35-661ea0278d35 could not be found. Jun 03 09:58:22.868234 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:22.868234 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-0faa462d-5f1b-494c-8390-735f4cdb9b88 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] Returning 404 to user: Volume c2214940-9dc1-49db-af35-661ea0278d35 could not be found. {{(pid=125065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:58:22.868234 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-0faa462d-5f1b-494c-8390-735f4cdb9b88 tempest-VolumesSnapshotsTestJSON-344529397 tempest-VolumesSnapshotsTestJSON-344529397-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/c2214940-9dc1-49db-af35-661ea0278d35" status: 404 len: 109 microversion: 2.1 time: 0.065120 Jun 03 09:58:22.868234 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 20/33] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 3 09:58:22 2022] GET /compute/v2.1/os-volumes/c2214940-9dc1-49db-af35-661ea0278d35 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:58:23.483569 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-c6c244da-a167-44c8-a6a4-041e9212effd tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:23.484858 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-c6c244da-a167-44c8-a6a4-041e9212effd tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:23.498127 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c6c244da-a167-44c8-a6a4-041e9212effd tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:23.498853 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c6c244da-a167-44c8-a6a4-041e9212effd tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:23.501250 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c6c244da-a167-44c8-a6a4-041e9212effd tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:23.501931 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c6c244da-a167-44c8-a6a4-041e9212effd tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:23.934689 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-c6c244da-a167-44c8-a6a4-041e9212effd tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:23.957351 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-c6c244da-a167-44c8-a6a4-041e9212effd tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1273 microversion: 2.1 time: 0.482970 Jun 03 09:58:23.959079 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 14/34] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:23 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1273 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:58:24.994395 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-1ecccd42-2df2-4359-ba6a-1c958e9741b2 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:24.997139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-1ecccd42-2df2-4359-ba6a-1c958e9741b2 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:25.031352 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1ecccd42-2df2-4359-ba6a-1c958e9741b2 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:25.058327 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1ecccd42-2df2-4359-ba6a-1c958e9741b2 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:25.080979 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1ecccd42-2df2-4359-ba6a-1c958e9741b2 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:25.081520 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-0de2305b-d914-4f4d-a3b3-f093d1cb6c46 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-903158543", "imageRef": "0d2dd03b-4531-46f3-88da-0380e97b1bd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:58:25.084108 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1ecccd42-2df2-4359-ba6a-1c958e9741b2 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:25.640029 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.network.neutron [None req-0de2305b-d914-4f4d-a3b3-f093d1cb6c46 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] validate_networks() for [('27ad8cbb-ba5a-4502-afc9-811304412397', None, None, None, None, None)] {{(pid=125065) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:58:25.839738 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell0:SELECT=2 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:26.004234 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-1ecccd42-2df2-4359-ba6a-1c958e9741b2 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:26.035697 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-1ecccd42-2df2-4359-ba6a-1c958e9741b2 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1315 microversion: 2.1 time: 1.044186 Jun 03 09:58:26.054736 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 15/35] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:24 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1315 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:27.108152 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-257ce6a5-c012-4a64-8b62-9d1ef26c178c tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Action: 'create', calling method: .version_select at 0x7f8d30b6edc0>, body: {"keypair": {"name": "tempest-keypair-1708535609", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPp/RmJ76NeBdfpJQgiJUjoksfXYDSbwOGenTnmkGIo1BbYvLx3XAk3Is5kYwvD5KQViFMphvcCLQj4CdWJlOqigL7nCMBhyJKIYRvZVy2tUgblwD59tjarp7EDNGqja+A=="}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:58:27.169925 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-257ce6a5-c012-4a64-8b62-9d1ef26c178c tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Getting quotas for project 686f552be5824c8aa31930a6e8844255. Resources: {'key_pairs'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:58:27.181303 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-257ce6a5-c012-4a64-8b62-9d1ef26c178c tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Getting quotas for user 49efae911ef8458b9288558014217934 and project 686f552be5824c8aa31930a6e8844255. Resources: {'key_pairs'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:58:27.398158 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-257ce6a5-c012-4a64-8b62-9d1ef26c178c tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.351900 Jun 03 09:58:27.402448 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 16/36] 10.222.0.42 () {60 vars in 1158 bytes} [Fri Jun 3 09:58:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:58:27.404781 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-722840d7-ee19-44b6-a9b8-6d4d91b4fb28 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:27.405937 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-722840d7-ee19-44b6-a9b8-6d4d91b4fb28 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:27.423963 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-722840d7-ee19-44b6-a9b8-6d4d91b4fb28 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:27.424744 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-722840d7-ee19-44b6-a9b8-6d4d91b4fb28 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:27.428243 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-722840d7-ee19-44b6-a9b8-6d4d91b4fb28 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:27.440063 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-722840d7-ee19-44b6-a9b8-6d4d91b4fb28 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:27.990222 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-0de2305b-d914-4f4d-a3b3-f093d1cb6c46 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Flavor limits 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:58:27.990747 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-0de2305b-d914-4f4d-a3b3-f093d1cb6c46 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Image limits 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:58:27.991078 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-0de2305b-d914-4f4d-a3b3-f093d1cb6c46 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Flavor pref 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:58:27.991498 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-0de2305b-d914-4f4d-a3b3-f093d1cb6c46 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Image pref 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:58:27.991939 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-0de2305b-d914-4f4d-a3b3-f093d1cb6c46 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:58:28.021709 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0de2305b-d914-4f4d-a3b3-f093d1cb6c46 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:28.021709 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0de2305b-d914-4f4d-a3b3-f093d1cb6c46 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:28.021709 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0de2305b-d914-4f4d-a3b3-f093d1cb6c46 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:28.021709 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0de2305b-d914-4f4d-a3b3-f093d1cb6c46 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:28.074445 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.quota [None req-0de2305b-d914-4f4d-a3b3-f093d1cb6c46 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Getting quotas for project 071b399988474af1a1c709aac97c1744. Resources: {'ram', 'instances', 'cores'} {{(pid=125065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:58:28.108376 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.quota [None req-0de2305b-d914-4f4d-a3b3-f093d1cb6c46 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Getting quotas for user 6113d715500240098217caf641db763a and project 071b399988474af1a1c709aac97c1744. Resources: {'ram', 'instances', 'cores'} {{(pid=125065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:58:28.138563 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-0de2305b-d914-4f4d-a3b3-f093d1cb6c46 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Going to run 1 instances... {{(pid=125065) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:58:28.145037 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-0de2305b-d914-4f4d-a3b3-f093d1cb6c46 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2dd03b-4531-46f3-88da-0380e97b1bd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:58:28.487157 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-0de2305b-d914-4f4d-a3b3-f093d1cb6c46 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.226521 Jun 03 09:58:28.487853 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 21/37] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 3 09:58:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 4228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 09:58:28.791657 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-722840d7-ee19-44b6-a9b8-6d4d91b4fb28 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:28.826534 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-722840d7-ee19-44b6-a9b8-6d4d91b4fb28 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1315 microversion: 2.1 time: 1.425932 Jun 03 09:58:28.827956 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 17/38] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:27 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1315 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:28.850521 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-06d8300d-1eaf-4d4c-a479-f9fccd1f6d1e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:28.867504 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-06d8300d-1eaf-4d4c-a479-f9fccd1f6d1e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:29.220802 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-06d8300d-1eaf-4d4c-a479-f9fccd1f6d1e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:29.228380 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-06d8300d-1eaf-4d4c-a479-f9fccd1f6d1e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 200 len: 1221 microversion: 2.1 time: 0.397285 Jun 03 09:58:29.237144 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 18/39] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:28 2022] GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 1221 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:29.312978 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-355de6da-2ae7-4a40-ae33-06e9e4d71cd6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Action: 'create', calling method: .version_select at 0x7f8d313e7820>, body: {"keypair": {"name": "tempest-keypair-1494498149", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4nJ7VnzWXTYcc+Ew5Cqc1Y3hk5B0YmnChif8Mydlx2aq/6p7tb+RABhGXUlx7pc0iLKubKwbSsA9cwk+ZLUVP0Yef2iCh8rFxSpjclAQWdmqsbsamAZXvXrGencM74Vg=="}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:58:29.407642 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.quota [None req-355de6da-2ae7-4a40-ae33-06e9e4d71cd6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Getting quotas for project 57756244f164417dad785bb5927d05b6. Resources: {'key_pairs'} {{(pid=125065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:58:29.415252 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.quota [None req-355de6da-2ae7-4a40-ae33-06e9e4d71cd6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Getting quotas for user 5a304d58eff84a87953dc7af6a0afe87 and project 57756244f164417dad785bb5927d05b6. Resources: {'key_pairs'} {{(pid=125065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:58:29.696902 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-355de6da-2ae7-4a40-ae33-06e9e4d71cd6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.207574 Jun 03 09:58:29.697729 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 22/40] 10.222.0.42 () {62 vars in 1199 bytes} [Fri Jun 3 09:58:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1209 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 03 09:58:29.702670 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-d3d534f1-1acc-4bb7-abef-b8b4dca16730 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-491011234", "imageRef": "0d2dd03b-4531-46f3-88da-0380e97b1bd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:58:29.845638 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-dec770cb-fb84-4489-87be-052a4ac1ea47 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:29.846521 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-dec770cb-fb84-4489-87be-052a4ac1ea47 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:29.859774 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-dec770cb-fb84-4489-87be-052a4ac1ea47 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:29.867369 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-dec770cb-fb84-4489-87be-052a4ac1ea47 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:29.868202 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-dec770cb-fb84-4489-87be-052a4ac1ea47 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:29.868643 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-dec770cb-fb84-4489-87be-052a4ac1ea47 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:29.870674 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.network.neutron [None req-d3d534f1-1acc-4bb7-abef-b8b4dca16730 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] validate_networks() for [('27ad8cbb-ba5a-4502-afc9-811304412397', None, None, None, None, None)] {{(pid=125066) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:58:31.540072 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-dec770cb-fb84-4489-87be-052a4ac1ea47 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:31.588710 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-dec770cb-fb84-4489-87be-052a4ac1ea47 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1315 microversion: 2.1 time: 1.747680 Jun 03 09:58:31.609640 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 23/41] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:29 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1315 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:58:32.414705 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-f37961ca-9550-470e-9100-25becf5a8b62 req-0f9ba81f-1bfa-48b4-ada3-412501ccfebb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fee24c1-4a54-47e9-9a0a-0726af3cf00a", "tag": "7f22a49d-b6ec-4dd7-93b2-f7ec2f927c22"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:58:32.449662 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-f37961ca-9550-470e-9100-25becf5a8b62 req-0f9ba81f-1bfa-48b4-ada3-412501ccfebb service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:32.450039 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-f37961ca-9550-470e-9100-25becf5a8b62 req-0f9ba81f-1bfa-48b4-ada3-412501ccfebb service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:32.540739 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-f37961ca-9550-470e-9100-25becf5a8b62 req-0f9ba81f-1bfa-48b4-ada3-412501ccfebb service nova] Creating event network-changed:7f22a49d-b6ec-4dd7-93b2-f7ec2f927c22 for instance 0fee24c1-4a54-47e9-9a0a-0726af3cf00a on hv-cinder-84456 Jun 03 09:58:32.541937 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-f37961ca-9550-470e-9100-25becf5a8b62 req-0f9ba81f-1bfa-48b4-ada3-412501ccfebb service nova] Acquired lock "compute-rpcapi-router" {{(pid=125065) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 03 09:58:32.543293 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-89259e7c-a50c-4f5f-b9fb-a5ee14c9d2e4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:32.543903 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-89259e7c-a50c-4f5f-b9fb-a5ee14c9d2e4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:32.544841 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-89259e7c-a50c-4f5f-b9fb-a5ee14c9d2e4 None None] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:32.545768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-89259e7c-a50c-4f5f-b9fb-a5ee14c9d2e4 None None] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:32.572885 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.compute.rpcapi [None req-89259e7c-a50c-4f5f-b9fb-a5ee14c9d2e4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 03 09:58:32.574145 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-89259e7c-a50c-4f5f-b9fb-a5ee14c9d2e4 None None] Releasing lock "compute-rpcapi-router" {{(pid=125065) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 03 09:58:32.621848 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-89259e7c-a50c-4f5f-b9fb-a5ee14c9d2e4 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.003819 Jun 03 09:58:32.621848 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 24/42] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 09:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:58:32.633472 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-475b0825-4640-4a4a-b7f7-9f21206ceaec tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:32.634441 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-475b0825-4640-4a4a-b7f7-9f21206ceaec tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:32.667854 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-475b0825-4640-4a4a-b7f7-9f21206ceaec tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:32.671474 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-475b0825-4640-4a4a-b7f7-9f21206ceaec tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:32.674896 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-475b0825-4640-4a4a-b7f7-9f21206ceaec tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:32.675594 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-475b0825-4640-4a4a-b7f7-9f21206ceaec tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:32.680284 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-d3d534f1-1acc-4bb7-abef-b8b4dca16730 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Flavor limits 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:58:32.681182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-d3d534f1-1acc-4bb7-abef-b8b4dca16730 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Image limits 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:58:32.681750 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-d3d534f1-1acc-4bb7-abef-b8b4dca16730 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Flavor pref 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:58:32.686721 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-d3d534f1-1acc-4bb7-abef-b8b4dca16730 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Image pref 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:58:32.686721 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-d3d534f1-1acc-4bb7-abef-b8b4dca16730 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:58:32.722310 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d3d534f1-1acc-4bb7-abef-b8b4dca16730 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:32.722513 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d3d534f1-1acc-4bb7-abef-b8b4dca16730 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:32.723379 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d3d534f1-1acc-4bb7-abef-b8b4dca16730 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:32.723909 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d3d534f1-1acc-4bb7-abef-b8b4dca16730 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:32.839784 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-d3d534f1-1acc-4bb7-abef-b8b4dca16730 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Getting quotas for project 071b399988474af1a1c709aac97c1744. Resources: {'ram', 'instances', 'cores'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:58:32.881871 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-d3d534f1-1acc-4bb7-abef-b8b4dca16730 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Getting quotas for user 6113d715500240098217caf641db763a and project 071b399988474af1a1c709aac97c1744. Resources: {'ram', 'instances', 'cores'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:58:32.922035 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-d3d534f1-1acc-4bb7-abef-b8b4dca16730 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Going to run 1 instances... {{(pid=125066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:58:32.924839 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-d3d534f1-1acc-4bb7-abef-b8b4dca16730 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2dd03b-4531-46f3-88da-0380e97b1bd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:58:33.117579 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-475b0825-4640-4a4a-b7f7-9f21206ceaec tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:33.132637 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-475b0825-4640-4a4a-b7f7-9f21206ceaec tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1315 microversion: 2.1 time: 0.512626 Jun 03 09:58:33.159765 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 25/43] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:32 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1315 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:33.159902 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-d3d534f1-1acc-4bb7-abef-b8b4dca16730 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.459501 Jun 03 09:58:33.159902 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 19/44] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 3 09:58:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 3465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 09:58:33.176912 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-362fe50a-e461-46b7-a724-b62611344236 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:33.203073 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-362fe50a-e461-46b7-a724-b62611344236 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:33.565956 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-362fe50a-e461-46b7-a724-b62611344236 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:33.578647 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-362fe50a-e461-46b7-a724-b62611344236 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1221 microversion: 2.1 time: 0.411312 Jun 03 09:58:33.579090 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 26/45] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:33 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1221 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:33.736268 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-a9216fd5-4eab-4f21-96d2-2533cde84942 tempest-VolumesNegativeTest-1388757794 tempest-VolumesNegativeTest-1388757794-project] Action: 'create', calling method: .version_select at 0x7f8d30b66ee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-490981618", "metadata": {"Type": "work"}}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:58:33.764344 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-a9216fd5-4eab-4f21-96d2-2533cde84942 tempest-VolumesNegativeTest-1388757794 tempest-VolumesNegativeTest-1388757794-project] Request method failure captured: Jun 03 09:58:33.764344 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 03 09:58:33.764344 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept: application/json Jun 03 09:58:33.764344 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept-Encoding: identity Jun 03 09:58:33.764344 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Connection: close Jun 03 09:58:33.764344 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Length: 121 Jun 03 09:58:33.764344 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Type: application/json Jun 03 09:58:33.764344 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Host: 10.222.0.42 Jun 03 09:58:33.764344 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Openstack-System-Scope: None Jun 03 09:58:33.764344 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: User-Agent: python-urllib3/1.26.9 Jun 03 09:58:33.764344 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Auth-Token: gAAAAABimdtJqJHbLBmvlAfQF5KbAb7rxuDNJIjRoDV8PHH0VOhiO4xyVXU5nx6oCsxxTNp5Iabey3u4-Orf58c0oMhXmyEBnet7Jqcz_9uws_7aQ_9aE6xnqDgbIcb5eXIw0al4C8aeeGK30PehzqA7qClUYicUZgPozBxGOlJZOlcFU6D782Q Jun 03 09:58:33.764344 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Id: None Jun 03 09:58:33.764344 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Name: None Jun 03 09:58:33.764344 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Identity-Status: Confirmed Jun 03 09:58:33.764344 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Is-Admin-Project: True Jun 03 09:58:33.764344 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Id: default Jun 03 09:58:33.764344 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Name: Default Jun 03 09:58:33.764344 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Id: 710f8018e9e94e8db41725502dce8978 Jun 03 09:58:33.764344 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Name: tempest-VolumesNegativeTest-1388757794 Jun 03 09:58:33.764344 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Role: member,reader Jun 03 09:58:33.764344 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Roles: member,reader Jun 03 09:58:33.765509 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/710f8018e9e94e8db41725502dce8978"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/710f8018e9e94e8db41725502dce8978"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_710f8018e9e94e8db41725502dce8978", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/710f8018e9e94e8db41725502dce8978"}]}] Jun 03 09:58:33.765509 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant: tempest-VolumesNegativeTest-1388757794 Jun 03 09:58:33.765509 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Id: 710f8018e9e94e8db41725502dce8978 Jun 03 09:58:33.765509 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Name: tempest-VolumesNegativeTest-1388757794 Jun 03 09:58:33.765509 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User: tempest-VolumesNegativeTest-1388757794-project Jun 03 09:58:33.765509 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Id: default Jun 03 09:58:33.765509 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Name: Default Jun 03 09:58:33.765509 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Id: 4dadf566d4b14f4a84920dd441831022 Jun 03 09:58:33.765509 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Name: tempest-VolumesNegativeTest-1388757794-project Jun 03 09:58:33.765509 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Jun 03 09:58:33.765509 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-490981618", "metadata": {"Type": "work"}}} Jun 03 09:58:33.765509 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: method: Jun 03 09:58:33.765509 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 03 09:58:33.766249 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-490981618', 'metadata': {'Type': 'work'}}}} Jun 03 09:58:33.766249 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:58:33.766249 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:33.766249 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 03 09:58:33.766249 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 03 09:58:33.766249 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 03 09:58:33.766249 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise error Jun 03 09:58:33.766249 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 03 09:58:33.766249 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:33.766249 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 03 09:58:33.766249 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 03 09:58:33.766249 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:33.766249 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 03 09:58:33.766249 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi '#$%' Jun 03 09:58:33.766249 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:33.766249 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:33.766249 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:33.766249 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:33.766249 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:58:33.766249 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:58:33.766249 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:58:33.766249 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:58:33.767419 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 09:58:33.767419 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 09:58:33.767419 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:58:33.767419 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:58:33.767419 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 03 09:58:33.767419 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 03 09:58:33.767419 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 03 09:58:33.767419 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 03 09:58:33.767419 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 03 09:58:33.767419 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 03 09:58:33.767419 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 03 09:58:33.767419 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:33.767419 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:33.767419 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:33.767419 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:33.767419 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:58:33.767419 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:58:33.767419 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 03 09:58:33.767419 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 03 09:58:33.768611 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 03 09:58:33.768611 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:33.768611 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-a9216fd5-4eab-4f21-96d2-2533cde84942 tempest-VolumesNegativeTest-1388757794 tempest-VolumesNegativeTest-1388757794-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=125066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:58:33.778911 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-a9216fd5-4eab-4f21-96d2-2533cde84942 tempest-VolumesNegativeTest-1388757794 tempest-VolumesNegativeTest-1388757794-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.315526 Jun 03 09:58:33.782573 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 20/46] 10.222.0.42 () {60 vars in 1155 bytes} [Fri Jun 3 09:58:33 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 320 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 09:58:33.792443 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-a7202bb0-c6f3-40bd-ab86-2a00af22b50c tempest-VolumesNegativeTest-1388757794 tempest-VolumesNegativeTest-1388757794-project] Action: 'create', calling method: .version_select at 0x7f8d302d5ee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1381948287", "metadata": {"Type": "work"}}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:58:33.797316 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-a7202bb0-c6f3-40bd-ab86-2a00af22b50c tempest-VolumesNegativeTest-1388757794 tempest-VolumesNegativeTest-1388757794-project] Request method failure captured: Jun 03 09:58:33.797316 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 03 09:58:33.797316 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept: application/json Jun 03 09:58:33.797316 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept-Encoding: identity Jun 03 09:58:33.797316 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Connection: close Jun 03 09:58:33.797316 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Length: 120 Jun 03 09:58:33.797316 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Type: application/json Jun 03 09:58:33.797316 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Host: 10.222.0.42 Jun 03 09:58:33.797316 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Openstack-System-Scope: None Jun 03 09:58:33.797316 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: User-Agent: python-urllib3/1.26.9 Jun 03 09:58:33.797316 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Auth-Token: gAAAAABimdtJqJHbLBmvlAfQF5KbAb7rxuDNJIjRoDV8PHH0VOhiO4xyVXU5nx6oCsxxTNp5Iabey3u4-Orf58c0oMhXmyEBnet7Jqcz_9uws_7aQ_9aE6xnqDgbIcb5eXIw0al4C8aeeGK30PehzqA7qClUYicUZgPozBxGOlJZOlcFU6D782Q Jun 03 09:58:33.797316 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Id: None Jun 03 09:58:33.797316 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Name: None Jun 03 09:58:33.797316 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Identity-Status: Confirmed Jun 03 09:58:33.797316 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Is-Admin-Project: True Jun 03 09:58:33.797316 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Id: default Jun 03 09:58:33.797316 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Name: Default Jun 03 09:58:33.797316 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Id: 710f8018e9e94e8db41725502dce8978 Jun 03 09:58:33.797316 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Name: tempest-VolumesNegativeTest-1388757794 Jun 03 09:58:33.797316 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Role: member,reader Jun 03 09:58:33.797316 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Roles: member,reader Jun 03 09:58:33.798601 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/710f8018e9e94e8db41725502dce8978"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/710f8018e9e94e8db41725502dce8978"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_710f8018e9e94e8db41725502dce8978", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/710f8018e9e94e8db41725502dce8978"}]}] Jun 03 09:58:33.798601 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant: tempest-VolumesNegativeTest-1388757794 Jun 03 09:58:33.798601 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Id: 710f8018e9e94e8db41725502dce8978 Jun 03 09:58:33.798601 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Name: tempest-VolumesNegativeTest-1388757794 Jun 03 09:58:33.798601 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User: tempest-VolumesNegativeTest-1388757794-project Jun 03 09:58:33.798601 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Id: default Jun 03 09:58:33.798601 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Name: Default Jun 03 09:58:33.798601 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Id: 4dadf566d4b14f4a84920dd441831022 Jun 03 09:58:33.798601 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Name: tempest-VolumesNegativeTest-1388757794-project Jun 03 09:58:33.798601 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Jun 03 09:58:33.798601 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1381948287", "metadata": {"Type": "work"}}} Jun 03 09:58:33.798601 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: method: Jun 03 09:58:33.798601 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 03 09:58:33.799437 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1381948287', 'metadata': {'Type': 'work'}}}} Jun 03 09:58:33.799437 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:58:33.799437 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:33.799437 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 03 09:58:33.799437 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 03 09:58:33.799437 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 03 09:58:33.799437 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise error Jun 03 09:58:33.799437 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 03 09:58:33.799437 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:33.799437 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 03 09:58:33.799437 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 03 09:58:33.799437 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:33.799437 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 03 09:58:33.799437 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi '0' Jun 03 09:58:33.799437 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:33.799437 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:33.799437 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:33.799437 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:33.799437 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:58:33.799437 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:58:33.799437 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:58:33.799437 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:58:33.800843 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 09:58:33.800843 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 09:58:33.800843 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:58:33.800843 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:58:33.800843 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 03 09:58:33.800843 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 03 09:58:33.800843 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 03 09:58:33.800843 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 03 09:58:33.800843 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 03 09:58:33.800843 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 03 09:58:33.800843 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 03 09:58:33.800843 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:33.800843 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:33.800843 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:33.800843 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:33.800843 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:58:33.800843 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:58:33.800843 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 03 09:58:33.800843 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 03 09:58:33.802474 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 03 09:58:33.802474 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:33.803665 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-a7202bb0-c6f3-40bd-ab86-2a00af22b50c tempest-VolumesNegativeTest-1388757794 tempest-VolumesNegativeTest-1388757794-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=125065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:58:33.808188 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-a7202bb0-c6f3-40bd-ab86-2a00af22b50c tempest-VolumesNegativeTest-1388757794 tempest-VolumesNegativeTest-1388757794-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.020193 Jun 03 09:58:33.832313 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 27/47] 10.222.0.42 () {60 vars in 1155 bytes} [Fri Jun 3 09:58:33 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 09:58:33.836527 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-ccf51b18-7bd9-4d03-9b49-3da155e0b06c tempest-VolumesNegativeTest-1388757794 tempest-VolumesNegativeTest-1388757794-project] Action: 'create', calling method: .version_select at 0x7f8d30bbadc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1168259120", "metadata": {"Type": "work"}}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:58:33.847189 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-ccf51b18-7bd9-4d03-9b49-3da155e0b06c tempest-VolumesNegativeTest-1388757794 tempest-VolumesNegativeTest-1388757794-project] Request method failure captured: Jun 03 09:58:33.847189 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 03 09:58:33.847189 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept: application/json Jun 03 09:58:33.847189 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept-Encoding: identity Jun 03 09:58:33.847189 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Connection: close Jun 03 09:58:33.847189 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Length: 119 Jun 03 09:58:33.847189 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Type: application/json Jun 03 09:58:33.847189 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Host: 10.222.0.42 Jun 03 09:58:33.847189 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Openstack-System-Scope: None Jun 03 09:58:33.847189 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: User-Agent: python-urllib3/1.26.9 Jun 03 09:58:33.847189 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Auth-Token: gAAAAABimdtJqJHbLBmvlAfQF5KbAb7rxuDNJIjRoDV8PHH0VOhiO4xyVXU5nx6oCsxxTNp5Iabey3u4-Orf58c0oMhXmyEBnet7Jqcz_9uws_7aQ_9aE6xnqDgbIcb5eXIw0al4C8aeeGK30PehzqA7qClUYicUZgPozBxGOlJZOlcFU6D782Q Jun 03 09:58:33.847189 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Id: None Jun 03 09:58:33.847189 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Name: None Jun 03 09:58:33.847189 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Identity-Status: Confirmed Jun 03 09:58:33.847189 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Is-Admin-Project: True Jun 03 09:58:33.847189 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Id: default Jun 03 09:58:33.847189 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Name: Default Jun 03 09:58:33.847189 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Id: 710f8018e9e94e8db41725502dce8978 Jun 03 09:58:33.847189 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Name: tempest-VolumesNegativeTest-1388757794 Jun 03 09:58:33.847189 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Role: member,reader Jun 03 09:58:33.847189 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Roles: member,reader Jun 03 09:58:33.848399 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/710f8018e9e94e8db41725502dce8978"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/710f8018e9e94e8db41725502dce8978"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_710f8018e9e94e8db41725502dce8978", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/710f8018e9e94e8db41725502dce8978"}]}] Jun 03 09:58:33.848399 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant: tempest-VolumesNegativeTest-1388757794 Jun 03 09:58:33.848399 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Id: 710f8018e9e94e8db41725502dce8978 Jun 03 09:58:33.848399 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Name: tempest-VolumesNegativeTest-1388757794 Jun 03 09:58:33.848399 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User: tempest-VolumesNegativeTest-1388757794-project Jun 03 09:58:33.848399 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Id: default Jun 03 09:58:33.848399 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Name: Default Jun 03 09:58:33.848399 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Id: 4dadf566d4b14f4a84920dd441831022 Jun 03 09:58:33.848399 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Name: tempest-VolumesNegativeTest-1388757794-project Jun 03 09:58:33.848399 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Jun 03 09:58:33.848399 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1168259120", "metadata": {"Type": "work"}}} Jun 03 09:58:33.848399 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: method: Jun 03 09:58:33.848399 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 03 09:58:33.849086 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1168259120', 'metadata': {'Type': 'work'}}}} Jun 03 09:58:33.849086 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:58:33.849086 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:33.849086 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 03 09:58:33.849086 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 03 09:58:33.849086 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 03 09:58:33.849086 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise error Jun 03 09:58:33.849086 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 03 09:58:33.849086 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:33.849086 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 03 09:58:33.849086 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 03 09:58:33.849086 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:33.849086 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 03 09:58:33.849086 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi '' Jun 03 09:58:33.849086 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:33.849086 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:33.849086 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:33.849086 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:33.849086 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:58:33.849086 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:58:33.849086 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:58:33.849086 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:58:33.850295 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 09:58:33.850295 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 09:58:33.850295 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:58:33.850295 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:58:33.850295 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 03 09:58:33.850295 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 03 09:58:33.850295 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 03 09:58:33.850295 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 03 09:58:33.850295 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 03 09:58:33.850295 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 03 09:58:33.850295 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 03 09:58:33.850295 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:33.850295 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:33.850295 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:33.850295 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:33.850295 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:58:33.850295 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:58:33.850295 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 03 09:58:33.850295 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 03 09:58:33.851192 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 03 09:58:33.851192 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:33.855731 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-ccf51b18-7bd9-4d03-9b49-3da155e0b06c tempest-VolumesNegativeTest-1388757794 tempest-VolumesNegativeTest-1388757794-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=125066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:58:33.857765 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-ccf51b18-7bd9-4d03-9b49-3da155e0b06c tempest-VolumesNegativeTest-1388757794 tempest-VolumesNegativeTest-1388757794-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.030585 Jun 03 09:58:33.861310 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 21/48] 10.222.0.42 () {60 vars in 1155 bytes} [Fri Jun 3 09:58:33 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 09:58:33.872244 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-e1511f3f-da4b-4fe5-97e6-ae3d8465de62 tempest-VolumesNegativeTest-1388757794 tempest-VolumesNegativeTest-1388757794-project] Calling method '.version_select at 0x7f8d31cadb80>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:34.039006 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.wsgi [None req-e1511f3f-da4b-4fe5-97e6-ae3d8465de62 tempest-VolumesNegativeTest-1388757794 tempest-VolumesNegativeTest-1388757794-project] HTTP exception thrown: Volume tempest-invalid-2127082361 could not be found. Jun 03 09:58:34.041267 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-e1511f3f-da4b-4fe5-97e6-ae3d8465de62 tempest-VolumesNegativeTest-1388757794 tempest-VolumesNegativeTest-1388757794-project] Request method failure captured: Jun 03 09:58:34.041267 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2127082361 HTTP/1.1 Jun 03 09:58:34.041267 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept: application/json Jun 03 09:58:34.041267 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept-Encoding: identity Jun 03 09:58:34.041267 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Connection: close Jun 03 09:58:34.041267 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Length: 0 Jun 03 09:58:34.041267 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Type: application/json Jun 03 09:58:34.041267 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Host: 10.222.0.42 Jun 03 09:58:34.041267 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Openstack-System-Scope: None Jun 03 09:58:34.041267 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: User-Agent: python-urllib3/1.26.9 Jun 03 09:58:34.041267 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Auth-Token: gAAAAABimdtJqJHbLBmvlAfQF5KbAb7rxuDNJIjRoDV8PHH0VOhiO4xyVXU5nx6oCsxxTNp5Iabey3u4-Orf58c0oMhXmyEBnet7Jqcz_9uws_7aQ_9aE6xnqDgbIcb5eXIw0al4C8aeeGK30PehzqA7qClUYicUZgPozBxGOlJZOlcFU6D782Q Jun 03 09:58:34.041267 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Id: None Jun 03 09:58:34.041267 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Name: None Jun 03 09:58:34.041267 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Identity-Status: Confirmed Jun 03 09:58:34.041267 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Is-Admin-Project: True Jun 03 09:58:34.041267 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Id: default Jun 03 09:58:34.041267 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Name: Default Jun 03 09:58:34.041267 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Id: 710f8018e9e94e8db41725502dce8978 Jun 03 09:58:34.041267 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Name: tempest-VolumesNegativeTest-1388757794 Jun 03 09:58:34.041267 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Role: member,reader Jun 03 09:58:34.041267 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Roles: member,reader Jun 03 09:58:34.043099 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/710f8018e9e94e8db41725502dce8978"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/710f8018e9e94e8db41725502dce8978"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_710f8018e9e94e8db41725502dce8978", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/710f8018e9e94e8db41725502dce8978"}]}] Jun 03 09:58:34.043099 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant: tempest-VolumesNegativeTest-1388757794 Jun 03 09:58:34.043099 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Id: 710f8018e9e94e8db41725502dce8978 Jun 03 09:58:34.043099 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Name: tempest-VolumesNegativeTest-1388757794 Jun 03 09:58:34.043099 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User: tempest-VolumesNegativeTest-1388757794-project Jun 03 09:58:34.043099 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Id: default Jun 03 09:58:34.043099 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Name: Default Jun 03 09:58:34.043099 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Id: 4dadf566d4b14f4a84920dd441831022 Jun 03 09:58:34.043099 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Name: tempest-VolumesNegativeTest-1388757794-project Jun 03 09:58:34.043099 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: method: Jun 03 09:58:34.043099 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: exception: Volume tempest-invalid-2127082361 could not be found. Jun 03 09:58:34.043099 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: action_args: {'id': 'tempest-invalid-2127082361'} Jun 03 09:58:34.043099 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:58:34.043823 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:34.043823 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:58:34.043823 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:58:34.043823 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 09:58:34.043823 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 09:58:34.043823 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 09:58:34.043823 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 09:58:34.043823 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 09:58:34.043823 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 09:58:34.043823 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 09:58:34.043823 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 09:58:34.043823 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:58:34.043823 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:58:34.043823 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:58:34.043823 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:58:34.043823 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2127082361 could not be found. (HTTP 404) (Request-ID: req-96600e31-c0df-4f68-a460-372fada02260) Jun 03 09:58:34.043823 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:34.043823 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:34.043823 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:34.044819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:34.044819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 03 09:58:34.044819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 03 09:58:34.044819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 09:58:34.044819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 09:58:34.044819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 09:58:34.044819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 09:58:34.044819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 09:58:34.044819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 09:58:34.044819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:58:34.044819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:58:34.044819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 09:58:34.044819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 09:58:34.044819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 09:58:34.044819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 09:58:34.044819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 09:58:34.044819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 09:58:34.044819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 09:58:34.044819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 09:58:34.045869 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:58:34.045869 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:58:34.045869 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:58:34.045869 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:58:34.045869 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2127082361 could not be found. Jun 03 09:58:34.045869 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:34.045869 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:34.045869 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:34.045869 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:34.045869 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:58:34.045869 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:58:34.045869 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:58:34.045869 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:58:34.045869 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 09:58:34.045869 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 09:58:34.045869 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:58:34.045869 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:58:34.045869 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 03 09:58:34.045869 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:58:34.045869 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2127082361 could not be found. Jun 03 09:58:34.047123 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:34.047123 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:34.047123 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:34.047123 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:34.047123 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:58:34.047123 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:58:34.047123 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:58:34.047123 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:58:34.047123 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2127082361 could not be found. Jun 03 09:58:34.047123 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:58:34.047726 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-e1511f3f-da4b-4fe5-97e6-ae3d8465de62 tempest-VolumesNegativeTest-1388757794 tempest-VolumesNegativeTest-1388757794-project] Returning 404 to user: Volume tempest-invalid-2127082361 could not be found. {{(pid=125065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:58:34.049385 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-e1511f3f-da4b-4fe5-97e6-ae3d8465de62 tempest-VolumesNegativeTest-1388757794 tempest-VolumesNegativeTest-1388757794-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2127082361" status: 404 len: 99 microversion: 2.1 time: 0.183442 Jun 03 09:58:34.055942 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 28/49] 10.222.0.42 () {58 vars in 1217 bytes} [Fri Jun 3 09:58:33 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2127082361 => generated 99 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 03 09:58:34.064492 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-f0ffa436-ec95-4642-b920-e7669169de64 tempest-VolumesNegativeTest-1388757794 tempest-VolumesNegativeTest-1388757794-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007000 Jun 03 09:58:34.066034 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 22/50] 10.222.0.42 () {58 vars in 1139 bytes} [Fri Jun 3 09:58:34 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 03 09:58:34.084948 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-b317478a-d15f-4961-972c-174e36dddf36 tempest-VolumesNegativeTest-1388757794 tempest-VolumesNegativeTest-1388757794-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003967 Jun 03 09:58:34.085561 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 29/51] 10.222.0.42 () {58 vars in 1136 bytes} [Fri Jun 3 09:58:34 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 03 09:58:34.103045 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-4304a683-3532-43f2-b8e9-8aef13f42e52 tempest-VolumesNegativeTest-1388757794 tempest-VolumesNegativeTest-1388757794-project] Calling method '.version_select at 0x7f8d30ae3ca0>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:34.172778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.wsgi [None req-4304a683-3532-43f2-b8e9-8aef13f42e52 tempest-VolumesNegativeTest-1388757794 tempest-VolumesNegativeTest-1388757794-project] HTTP exception thrown: Volume 62aeda8b-5b74-413a-b155-b2d7bc865d92 could not be found. Jun 03 09:58:34.175592 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-5b84c3d2-9a3d-4329-a17b-4f73b157bb06 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:34.176221 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-5b84c3d2-9a3d-4329-a17b-4f73b157bb06 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:34.176982 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-4304a683-3532-43f2-b8e9-8aef13f42e52 tempest-VolumesNegativeTest-1388757794 tempest-VolumesNegativeTest-1388757794-project] Request method failure captured: Jun 03 09:58:34.176982 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: request: DELETE /compute/v2.1/os-volumes/62aeda8b-5b74-413a-b155-b2d7bc865d92 HTTP/1.1 Jun 03 09:58:34.176982 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept: application/json Jun 03 09:58:34.176982 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept-Encoding: identity Jun 03 09:58:34.176982 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Connection: close Jun 03 09:58:34.176982 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Length: 0 Jun 03 09:58:34.176982 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Type: application/json Jun 03 09:58:34.176982 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Host: 10.222.0.42 Jun 03 09:58:34.176982 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Openstack-System-Scope: None Jun 03 09:58:34.176982 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: User-Agent: python-urllib3/1.26.9 Jun 03 09:58:34.176982 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Auth-Token: gAAAAABimdtJqJHbLBmvlAfQF5KbAb7rxuDNJIjRoDV8PHH0VOhiO4xyVXU5nx6oCsxxTNp5Iabey3u4-Orf58c0oMhXmyEBnet7Jqcz_9uws_7aQ_9aE6xnqDgbIcb5eXIw0al4C8aeeGK30PehzqA7qClUYicUZgPozBxGOlJZOlcFU6D782Q Jun 03 09:58:34.176982 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Id: None Jun 03 09:58:34.176982 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Name: None Jun 03 09:58:34.176982 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Identity-Status: Confirmed Jun 03 09:58:34.176982 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Is-Admin-Project: True Jun 03 09:58:34.176982 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Id: default Jun 03 09:58:34.176982 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Name: Default Jun 03 09:58:34.176982 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Id: 710f8018e9e94e8db41725502dce8978 Jun 03 09:58:34.176982 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Name: tempest-VolumesNegativeTest-1388757794 Jun 03 09:58:34.176982 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Role: member,reader Jun 03 09:58:34.176982 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Roles: member,reader Jun 03 09:58:34.178090 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/710f8018e9e94e8db41725502dce8978"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/710f8018e9e94e8db41725502dce8978"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_710f8018e9e94e8db41725502dce8978", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/710f8018e9e94e8db41725502dce8978"}]}] Jun 03 09:58:34.178090 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant: tempest-VolumesNegativeTest-1388757794 Jun 03 09:58:34.178090 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Id: 710f8018e9e94e8db41725502dce8978 Jun 03 09:58:34.178090 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Name: tempest-VolumesNegativeTest-1388757794 Jun 03 09:58:34.178090 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User: tempest-VolumesNegativeTest-1388757794-project Jun 03 09:58:34.178090 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Id: default Jun 03 09:58:34.178090 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Name: Default Jun 03 09:58:34.178090 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Id: 4dadf566d4b14f4a84920dd441831022 Jun 03 09:58:34.178090 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Name: tempest-VolumesNegativeTest-1388757794-project Jun 03 09:58:34.178090 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: method: Jun 03 09:58:34.178090 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: exception: Volume 62aeda8b-5b74-413a-b155-b2d7bc865d92 could not be found. Jun 03 09:58:34.178090 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: action_args: {'id': '62aeda8b-5b74-413a-b155-b2d7bc865d92'} Jun 03 09:58:34.178090 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:58:34.178816 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:34.178816 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:58:34.178816 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:58:34.178816 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 09:58:34.178816 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 09:58:34.178816 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 09:58:34.178816 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 09:58:34.178816 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 09:58:34.178816 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 09:58:34.178816 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 09:58:34.178816 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 09:58:34.178816 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:58:34.178816 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:58:34.178816 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:58:34.178816 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:58:34.178816 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 62aeda8b-5b74-413a-b155-b2d7bc865d92 could not be found. (HTTP 404) (Request-ID: req-0f1e80d5-8665-4047-8972-2dde1d448f5d) Jun 03 09:58:34.178816 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:34.178816 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:34.178816 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:34.179830 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:34.179830 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 03 09:58:34.179830 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 03 09:58:34.179830 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 09:58:34.179830 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 09:58:34.179830 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 09:58:34.179830 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 09:58:34.179830 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 09:58:34.179830 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 09:58:34.179830 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:58:34.179830 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:58:34.179830 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 09:58:34.179830 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 09:58:34.179830 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 09:58:34.179830 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 09:58:34.179830 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 09:58:34.179830 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 09:58:34.179830 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 09:58:34.179830 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 09:58:34.180738 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:58:34.180738 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:58:34.180738 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:58:34.180738 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:58:34.180738 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 62aeda8b-5b74-413a-b155-b2d7bc865d92 could not be found. Jun 03 09:58:34.180738 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:34.180738 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:34.180738 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:34.180738 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:34.180738 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:58:34.180738 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:58:34.180738 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:58:34.180738 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:58:34.180738 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 09:58:34.180738 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 09:58:34.180738 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:58:34.180738 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:58:34.180738 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 03 09:58:34.180738 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:58:34.181632 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 62aeda8b-5b74-413a-b155-b2d7bc865d92 could not be found. Jun 03 09:58:34.181632 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:34.181632 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:34.181632 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:34.181632 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:34.181632 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:58:34.181632 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:58:34.181632 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:58:34.181632 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:58:34.181632 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 62aeda8b-5b74-413a-b155-b2d7bc865d92 could not be found. Jun 03 09:58:34.181632 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:34.189975 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-4304a683-3532-43f2-b8e9-8aef13f42e52 tempest-VolumesNegativeTest-1388757794 tempest-VolumesNegativeTest-1388757794-project] Returning 404 to user: Volume 62aeda8b-5b74-413a-b155-b2d7bc865d92 could not be found. {{(pid=125066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:58:34.191549 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-4304a683-3532-43f2-b8e9-8aef13f42e52 tempest-VolumesNegativeTest-1388757794 tempest-VolumesNegativeTest-1388757794-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/62aeda8b-5b74-413a-b155-b2d7bc865d92" status: 404 len: 109 microversion: 2.1 time: 0.100045 Jun 03 09:58:34.192689 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 23/52] 10.222.0.42 () {58 vars in 1247 bytes} [Fri Jun 3 09:58:34 2022] DELETE /compute/v2.1/os-volumes/62aeda8b-5b74-413a-b155-b2d7bc865d92 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:58:34.207543 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5b84c3d2-9a3d-4329-a17b-4f73b157bb06 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:34.216194 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5b84c3d2-9a3d-4329-a17b-4f73b157bb06 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:34.219968 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5b84c3d2-9a3d-4329-a17b-4f73b157bb06 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:34.237319 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-8450a013-5ca5-4f46-93b6-1781ba3ec915 tempest-VolumesNegativeTest-1388757794 tempest-VolumesNegativeTest-1388757794-project] Calling method '.version_select at 0x7f8d30bc7ca0>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:34.238077 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5b84c3d2-9a3d-4329-a17b-4f73b157bb06 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:34.367568 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.wsgi [None req-8450a013-5ca5-4f46-93b6-1781ba3ec915 tempest-VolumesNegativeTest-1388757794 tempest-VolumesNegativeTest-1388757794-project] HTTP exception thrown: Volume ae207534-c655-4199-91c0-8548bfcb6a43 could not be found. Jun 03 09:58:34.370778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-8450a013-5ca5-4f46-93b6-1781ba3ec915 tempest-VolumesNegativeTest-1388757794 tempest-VolumesNegativeTest-1388757794-project] Request method failure captured: Jun 03 09:58:34.370778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: request: GET /compute/v2.1/os-volumes/ae207534-c655-4199-91c0-8548bfcb6a43 HTTP/1.1 Jun 03 09:58:34.370778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept: application/json Jun 03 09:58:34.370778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept-Encoding: identity Jun 03 09:58:34.370778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Connection: close Jun 03 09:58:34.370778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Length: 0 Jun 03 09:58:34.370778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Type: application/json Jun 03 09:58:34.370778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Host: 10.222.0.42 Jun 03 09:58:34.370778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Openstack-System-Scope: None Jun 03 09:58:34.370778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: User-Agent: python-urllib3/1.26.9 Jun 03 09:58:34.370778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Auth-Token: gAAAAABimdtJqJHbLBmvlAfQF5KbAb7rxuDNJIjRoDV8PHH0VOhiO4xyVXU5nx6oCsxxTNp5Iabey3u4-Orf58c0oMhXmyEBnet7Jqcz_9uws_7aQ_9aE6xnqDgbIcb5eXIw0al4C8aeeGK30PehzqA7qClUYicUZgPozBxGOlJZOlcFU6D782Q Jun 03 09:58:34.370778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Id: None Jun 03 09:58:34.370778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Name: None Jun 03 09:58:34.370778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Identity-Status: Confirmed Jun 03 09:58:34.370778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Is-Admin-Project: True Jun 03 09:58:34.370778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Id: default Jun 03 09:58:34.370778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Name: Default Jun 03 09:58:34.370778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Id: 710f8018e9e94e8db41725502dce8978 Jun 03 09:58:34.370778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Name: tempest-VolumesNegativeTest-1388757794 Jun 03 09:58:34.370778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Role: member,reader Jun 03 09:58:34.370778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Roles: member,reader Jun 03 09:58:34.371964 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/710f8018e9e94e8db41725502dce8978"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/710f8018e9e94e8db41725502dce8978"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_710f8018e9e94e8db41725502dce8978", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/710f8018e9e94e8db41725502dce8978"}]}] Jun 03 09:58:34.371964 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant: tempest-VolumesNegativeTest-1388757794 Jun 03 09:58:34.371964 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Id: 710f8018e9e94e8db41725502dce8978 Jun 03 09:58:34.371964 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Name: tempest-VolumesNegativeTest-1388757794 Jun 03 09:58:34.371964 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User: tempest-VolumesNegativeTest-1388757794-project Jun 03 09:58:34.371964 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Id: default Jun 03 09:58:34.371964 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Name: Default Jun 03 09:58:34.371964 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Id: 4dadf566d4b14f4a84920dd441831022 Jun 03 09:58:34.371964 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Name: tempest-VolumesNegativeTest-1388757794-project Jun 03 09:58:34.371964 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: method: Jun 03 09:58:34.371964 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: exception: Volume ae207534-c655-4199-91c0-8548bfcb6a43 could not be found. Jun 03 09:58:34.371964 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: action_args: {'id': 'ae207534-c655-4199-91c0-8548bfcb6a43'} Jun 03 09:58:34.371964 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:58:34.372886 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:34.372886 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:58:34.372886 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:58:34.372886 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 09:58:34.372886 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 09:58:34.372886 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 09:58:34.372886 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 09:58:34.372886 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 09:58:34.372886 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 09:58:34.372886 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 09:58:34.372886 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 09:58:34.372886 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:58:34.372886 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:58:34.372886 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:58:34.372886 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:58:34.372886 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ae207534-c655-4199-91c0-8548bfcb6a43 could not be found. (HTTP 404) (Request-ID: req-9e3b0777-07f4-4447-9233-d41c3b75ee32) Jun 03 09:58:34.372886 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:34.372886 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:34.372886 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:34.373920 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:34.373920 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 03 09:58:34.373920 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 03 09:58:34.373920 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 09:58:34.373920 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 09:58:34.373920 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 09:58:34.373920 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 09:58:34.373920 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 09:58:34.373920 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 09:58:34.373920 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:58:34.373920 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:58:34.373920 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 09:58:34.373920 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 09:58:34.373920 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 09:58:34.373920 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 09:58:34.373920 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 09:58:34.373920 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 09:58:34.373920 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 09:58:34.373920 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 09:58:34.374944 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:58:34.374944 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:58:34.374944 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:58:34.374944 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:58:34.374944 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ae207534-c655-4199-91c0-8548bfcb6a43 could not be found. Jun 03 09:58:34.374944 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:34.374944 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:34.374944 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:34.374944 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:34.374944 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:58:34.374944 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:58:34.374944 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:58:34.374944 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:58:34.374944 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 09:58:34.374944 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 09:58:34.374944 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:58:34.374944 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:58:34.374944 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 03 09:58:34.374944 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:58:34.376630 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ae207534-c655-4199-91c0-8548bfcb6a43 could not be found. Jun 03 09:58:34.376630 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:34.376630 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:34.376630 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:34.376630 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:34.376630 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:58:34.376630 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:58:34.376630 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:58:34.376630 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:58:34.376630 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ae207534-c655-4199-91c0-8548bfcb6a43 could not be found. Jun 03 09:58:34.376630 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:58:34.376630 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-8450a013-5ca5-4f46-93b6-1781ba3ec915 tempest-VolumesNegativeTest-1388757794 tempest-VolumesNegativeTest-1388757794-project] Returning 404 to user: Volume ae207534-c655-4199-91c0-8548bfcb6a43 could not be found. {{(pid=125066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:58:34.379197 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-8450a013-5ca5-4f46-93b6-1781ba3ec915 tempest-VolumesNegativeTest-1388757794 tempest-VolumesNegativeTest-1388757794-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/ae207534-c655-4199-91c0-8548bfcb6a43" status: 404 len: 109 microversion: 2.1 time: 0.155557 Jun 03 09:58:34.383613 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 24/53] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 3 09:58:34 2022] GET /compute/v2.1/os-volumes/ae207534-c655-4199-91c0-8548bfcb6a43 => generated 109 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:58:34.395988 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-8b269840-2714-441a-9341-207eba006364 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1360820468", "imageRef": "0d2dd03b-4531-46f3-88da-0380e97b1bd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1b8baf95-875c-4b35-b8da-e86b3e7dbe4a"}], "security_groups": [{"name": "tempest-securitygroup--1157644275"}], "key_name": "tempest-keypair-1708535609", "user_data": "}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:58:34.757449 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.network.neutron [None req-8b269840-2714-441a-9341-207eba006364 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] validate_networks() for [('1b8baf95-875c-4b35-b8da-e86b3e7dbe4a', None, None, None, None, None)] {{(pid=125066) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:58:35.372531 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-5b84c3d2-9a3d-4329-a17b-4f73b157bb06 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:35.395032 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-5b84c3d2-9a3d-4329-a17b-4f73b157bb06 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1315 microversion: 2.1 time: 1.220782 Jun 03 09:58:35.397647 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 30/54] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:34 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1315 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:58:35.404217 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-a15913a2-9600-47ff-8a35-2ad428f0a033 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:35.406025 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-a15913a2-9600-47ff-8a35-2ad428f0a033 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:35.420547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a15913a2-9600-47ff-8a35-2ad428f0a033 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:35.421341 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a15913a2-9600-47ff-8a35-2ad428f0a033 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:35.422509 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a15913a2-9600-47ff-8a35-2ad428f0a033 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:35.423107 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a15913a2-9600-47ff-8a35-2ad428f0a033 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:35.669235 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-a15913a2-9600-47ff-8a35-2ad428f0a033 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:35.698264 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-a15913a2-9600-47ff-8a35-2ad428f0a033 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1225 microversion: 2.1 time: 0.298980 Jun 03 09:58:35.700680 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 31/55] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:35 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1225 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:36.431410 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-78648c01-03d0-4069-8a96-1aaa1efa2e31 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:36.435080 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-78648c01-03d0-4069-8a96-1aaa1efa2e31 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:36.462545 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-78648c01-03d0-4069-8a96-1aaa1efa2e31 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:36.470033 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-78648c01-03d0-4069-8a96-1aaa1efa2e31 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:36.471219 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-78648c01-03d0-4069-8a96-1aaa1efa2e31 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:36.473031 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-78648c01-03d0-4069-8a96-1aaa1efa2e31 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:37.323784 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-78648c01-03d0-4069-8a96-1aaa1efa2e31 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:37.333753 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-78648c01-03d0-4069-8a96-1aaa1efa2e31 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1315 microversion: 2.1 time: 0.924978 Jun 03 09:58:37.358464 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 32/56] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:36 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1315 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:37.362753 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-4b670db1-53f7-46b4-84df-8f479e271c08 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:37.366359 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-4b670db1-53f7-46b4-84df-8f479e271c08 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:37.380924 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4b670db1-53f7-46b4-84df-8f479e271c08 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:37.384010 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4b670db1-53f7-46b4-84df-8f479e271c08 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:37.388802 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4b670db1-53f7-46b4-84df-8f479e271c08 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:37.390270 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4b670db1-53f7-46b4-84df-8f479e271c08 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:37.627751 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-8b269840-2714-441a-9341-207eba006364 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Flavor limits 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:58:37.628243 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-8b269840-2714-441a-9341-207eba006364 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Image limits 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:58:37.628887 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-8b269840-2714-441a-9341-207eba006364 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Flavor pref 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:58:37.630014 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-8b269840-2714-441a-9341-207eba006364 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Image pref 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:58:37.631127 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-8b269840-2714-441a-9341-207eba006364 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:58:37.675113 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8b269840-2714-441a-9341-207eba006364 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:37.678959 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8b269840-2714-441a-9341-207eba006364 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:37.682055 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8b269840-2714-441a-9341-207eba006364 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:37.683066 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8b269840-2714-441a-9341-207eba006364 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:37.744213 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-8b269840-2714-441a-9341-207eba006364 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Getting quotas for project 686f552be5824c8aa31930a6e8844255. Resources: {'ram', 'instances', 'cores'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:58:37.754907 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-8b269840-2714-441a-9341-207eba006364 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Getting quotas for user 49efae911ef8458b9288558014217934 and project 686f552be5824c8aa31930a6e8844255. Resources: {'ram', 'instances', 'cores'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:58:37.766879 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-4b670db1-53f7-46b4-84df-8f479e271c08 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:37.782732 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-4b670db1-53f7-46b4-84df-8f479e271c08 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1291 microversion: 2.1 time: 0.425619 Jun 03 09:58:37.784267 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 33/57] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:37 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1291 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:37.786461 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-8b269840-2714-441a-9341-207eba006364 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Going to run 1 instances... {{(pid=125066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:58:37.790363 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-8b269840-2714-441a-9341-207eba006364 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2dd03b-4531-46f3-88da-0380e97b1bd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:58:37.804848 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-62172bf3-d401-4aa1-8b37-806bbbdd996f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-313746163", "imageRef": "0d2dd03b-4531-46f3-88da-0380e97b1bd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1dd31c87-764e-47aa-825b-25f1a52d1c3d"}], "security_groups": [{"name": "tempest-securitygroup--824890456"}], "key_name": "tempest-keypair-1494498149", "user_data": "}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:58:38.034729 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-8b269840-2714-441a-9341-207eba006364 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.650187 Jun 03 09:58:38.044209 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 25/58] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 3 09:58:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 3664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 09:58:38.068947 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-4a74b163-6760-4de2-af24-a88dfd01c9d8 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:38.069612 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-4a74b163-6760-4de2-af24-a88dfd01c9d8 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:38.440458 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.network.neutron [None req-62172bf3-d401-4aa1-8b37-806bbbdd996f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] validate_networks() for [('1dd31c87-764e-47aa-825b-25f1a52d1c3d', None, None, None, None, None)] {{(pid=125065) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:58:38.514351 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-4a74b163-6760-4de2-af24-a88dfd01c9d8 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:38.523223 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-4a74b163-6760-4de2-af24-a88dfd01c9d8 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1238 microversion: 2.1 time: 0.476379 Jun 03 09:58:38.524263 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 26/59] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:38 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1238 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:38.545374 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-5799ef82-58c6-4d89-afeb-7bf8133491c2 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:38.549753 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-5799ef82-58c6-4d89-afeb-7bf8133491c2 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:38.570700 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5799ef82-58c6-4d89-afeb-7bf8133491c2 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:38.572069 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5799ef82-58c6-4d89-afeb-7bf8133491c2 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:38.573118 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5799ef82-58c6-4d89-afeb-7bf8133491c2 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:38.575069 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5799ef82-58c6-4d89-afeb-7bf8133491c2 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:39.724228 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-5799ef82-58c6-4d89-afeb-7bf8133491c2 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:39.727286 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:SELECT=41 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:39.735665 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-5799ef82-58c6-4d89-afeb-7bf8133491c2 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1315 microversion: 2.1 time: 1.196945 Jun 03 09:58:39.736260 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 27/60] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:38 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1315 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:39.740772 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-6e317337-5ef4-478a-9893-622586179376 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:39.741394 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-6e317337-5ef4-478a-9893-622586179376 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:39.743207 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=10 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:39.757811 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6e317337-5ef4-478a-9893-622586179376 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:39.758481 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6e317337-5ef4-478a-9893-622586179376 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:39.759450 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6e317337-5ef4-478a-9893-622586179376 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:39.760041 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6e317337-5ef4-478a-9893-622586179376 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:39.900310 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-6e317337-5ef4-478a-9893-622586179376 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:39.914854 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-6e317337-5ef4-478a-9893-622586179376 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1279 microversion: 2.1 time: 0.174182 Jun 03 09:58:39.917841 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 28/61] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:39 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1279 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:39.934279 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-f7220afa-806a-4072-8ce5-5e78b3ca777a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:39.935440 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-f7220afa-806a-4072-8ce5-5e78b3ca777a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:39.953198 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f7220afa-806a-4072-8ce5-5e78b3ca777a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:39.953655 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f7220afa-806a-4072-8ce5-5e78b3ca777a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:39.954462 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f7220afa-806a-4072-8ce5-5e78b3ca777a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:39.954903 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f7220afa-806a-4072-8ce5-5e78b3ca777a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:40.184312 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-f7220afa-806a-4072-8ce5-5e78b3ca777a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:40.196607 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-f7220afa-806a-4072-8ce5-5e78b3ca777a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1242 microversion: 2.1 time: 0.275252 Jun 03 09:58:40.215591 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 29/62] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:39 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1242 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:40.221410 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-d4e3974c-006f-4239-be6a-24858e624e0a req-2b75b00b-8ff3-49e3-b2e4-547d3ab2c5a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28ff128f-ff5e-4889-9f83-bdfb4b86a83d", "tag": "d8e80358-de18-46e9-b759-6c8d92fd7f83"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:58:40.250954 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-d4e3974c-006f-4239-be6a-24858e624e0a req-2b75b00b-8ff3-49e3-b2e4-547d3ab2c5a1 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:40.251731 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-d4e3974c-006f-4239-be6a-24858e624e0a req-2b75b00b-8ff3-49e3-b2e4-547d3ab2c5a1 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:40.316175 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-d4e3974c-006f-4239-be6a-24858e624e0a req-2b75b00b-8ff3-49e3-b2e4-547d3ab2c5a1 service nova] Creating event network-changed:d8e80358-de18-46e9-b759-6c8d92fd7f83 for instance 28ff128f-ff5e-4889-9f83-bdfb4b86a83d on hv-cinder-84456 Jun 03 09:58:40.317144 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-d4e3974c-006f-4239-be6a-24858e624e0a req-2b75b00b-8ff3-49e3-b2e4-547d3ab2c5a1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125066) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 03 09:58:40.321397 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f8cee3b7-0e1c-4f28-a4d1-9c99c0a48d3c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:40.322331 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f8cee3b7-0e1c-4f28-a4d1-9c99c0a48d3c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:40.323503 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f8cee3b7-0e1c-4f28-a4d1-9c99c0a48d3c None None] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:40.326606 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f8cee3b7-0e1c-4f28-a4d1-9c99c0a48d3c None None] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:40.350962 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.compute.rpcapi [None req-f8cee3b7-0e1c-4f28-a4d1-9c99c0a48d3c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 03 09:58:40.357060 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f8cee3b7-0e1c-4f28-a4d1-9c99c0a48d3c None None] Releasing lock "compute-rpcapi-router" {{(pid=125066) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 03 09:58:40.408920 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-f8cee3b7-0e1c-4f28-a4d1-9c99c0a48d3c None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183952 Jun 03 09:58:40.408920 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 30/63] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 09:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:58:40.754346 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-e11062cc-cf95-4659-8f85-034a5765e47f tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:40.755040 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-e11062cc-cf95-4659-8f85-034a5765e47f tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:40.768183 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e11062cc-cf95-4659-8f85-034a5765e47f tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:40.772287 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e11062cc-cf95-4659-8f85-034a5765e47f tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:40.773581 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e11062cc-cf95-4659-8f85-034a5765e47f tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:40.774081 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e11062cc-cf95-4659-8f85-034a5765e47f tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:41.067189 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-62172bf3-d401-4aa1-8b37-806bbbdd996f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Flavor limits 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:58:41.068234 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-62172bf3-d401-4aa1-8b37-806bbbdd996f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Image limits 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:58:41.069070 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-62172bf3-d401-4aa1-8b37-806bbbdd996f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Flavor pref 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:58:41.071644 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-62172bf3-d401-4aa1-8b37-806bbbdd996f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Image pref 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:58:41.072440 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-62172bf3-d401-4aa1-8b37-806bbbdd996f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:58:41.094501 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-62172bf3-d401-4aa1-8b37-806bbbdd996f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:41.098050 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-62172bf3-d401-4aa1-8b37-806bbbdd996f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:41.101474 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-62172bf3-d401-4aa1-8b37-806bbbdd996f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:41.102509 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-62172bf3-d401-4aa1-8b37-806bbbdd996f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:41.118176 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-e11062cc-cf95-4659-8f85-034a5765e47f tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:41.129656 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-e11062cc-cf95-4659-8f85-034a5765e47f tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1315 microversion: 2.1 time: 0.380403 Jun 03 09:58:41.133910 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 31/64] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:40 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:58:41.146215 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-8e22eedc-4709-49e3-99ad-96783db08321 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:41.148999 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-8e22eedc-4709-49e3-99ad-96783db08321 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:41.149909 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.quota [None req-62172bf3-d401-4aa1-8b37-806bbbdd996f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Getting quotas for project 57756244f164417dad785bb5927d05b6. Resources: {'ram', 'instances', 'cores'} {{(pid=125065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:58:41.157553 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.quota [None req-62172bf3-d401-4aa1-8b37-806bbbdd996f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Getting quotas for user 5a304d58eff84a87953dc7af6a0afe87 and project 57756244f164417dad785bb5927d05b6. Resources: {'ram', 'instances', 'cores'} {{(pid=125065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:58:41.167106 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8e22eedc-4709-49e3-99ad-96783db08321 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:41.167447 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-62172bf3-d401-4aa1-8b37-806bbbdd996f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Going to run 1 instances... {{(pid=125065) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:58:41.168014 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8e22eedc-4709-49e3-99ad-96783db08321 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:41.168883 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8e22eedc-4709-49e3-99ad-96783db08321 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:41.169577 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8e22eedc-4709-49e3-99ad-96783db08321 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:41.170532 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-62172bf3-d401-4aa1-8b37-806bbbdd996f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2dd03b-4531-46f3-88da-0380e97b1bd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:58:41.332871 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-62172bf3-d401-4aa1-8b37-806bbbdd996f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.547367 Jun 03 09:58:41.333768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 34/65] 10.222.0.42 () {62 vars in 1187 bytes} [Fri Jun 3 09:58:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 3549 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 03 09:58:41.339053 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-5ad09979-aec9-46ba-9b42-94f8c2554dab tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:41.339910 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-5ad09979-aec9-46ba-9b42-94f8c2554dab tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:41.347714 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5ad09979-aec9-46ba-9b42-94f8c2554dab tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:41.348494 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5ad09979-aec9-46ba-9b42-94f8c2554dab tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:41.349272 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5ad09979-aec9-46ba-9b42-94f8c2554dab tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:41.349968 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5ad09979-aec9-46ba-9b42-94f8c2554dab tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:41.508750 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-5ad09979-aec9-46ba-9b42-94f8c2554dab tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:41.538360 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-5ad09979-aec9-46ba-9b42-94f8c2554dab tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1290 microversion: 2.1 time: 0.203046 Jun 03 09:58:41.538933 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 35/66] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:41 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1290 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:41.572193 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-44d957cf-746e-4ca4-8de5-8f9bd423daa3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:41.574937 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-44d957cf-746e-4ca4-8de5-8f9bd423daa3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:41.578948 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=7 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:41.601343 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-8e22eedc-4709-49e3-99ad-96783db08321 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:41.612886 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-8e22eedc-4709-49e3-99ad-96783db08321 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1321 microversion: 2.1 time: 0.477706 Jun 03 09:58:41.613625 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 32/67] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:41 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1321 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:41.712944 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-44d957cf-746e-4ca4-8de5-8f9bd423daa3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:41.715918 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell0:SELECT=21 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:41.722639 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-44d957cf-746e-4ca4-8de5-8f9bd423daa3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:41.727044 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-44d957cf-746e-4ca4-8de5-8f9bd423daa3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:41.731673 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-44d957cf-746e-4ca4-8de5-8f9bd423daa3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1281 microversion: 2.20 time: 0.181294 Jun 03 09:58:41.731673 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 36/68] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 09:58:41 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1281 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:58:42.149228 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-6d88af9e-b6f1-424f-9b3c-d48b5ceac60d tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:42.158828 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-6d88af9e-b6f1-424f-9b3c-d48b5ceac60d tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:42.163603 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6d88af9e-b6f1-424f-9b3c-d48b5ceac60d tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:42.165573 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6d88af9e-b6f1-424f-9b3c-d48b5ceac60d tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:42.166531 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6d88af9e-b6f1-424f-9b3c-d48b5ceac60d tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:42.167989 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6d88af9e-b6f1-424f-9b3c-d48b5ceac60d tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:42.557629 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-0e3ce4e2-0587-4617-a13e-25c2b2e741eb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:42.558269 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-0e3ce4e2-0587-4617-a13e-25c2b2e741eb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:42.568668 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0e3ce4e2-0587-4617-a13e-25c2b2e741eb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:42.569621 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0e3ce4e2-0587-4617-a13e-25c2b2e741eb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:42.570666 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0e3ce4e2-0587-4617-a13e-25c2b2e741eb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:42.571241 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0e3ce4e2-0587-4617-a13e-25c2b2e741eb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:42.654788 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-6d88af9e-b6f1-424f-9b3c-d48b5ceac60d tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:42.663444 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-0e3ce4e2-0587-4617-a13e-25c2b2e741eb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:42.664990 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-6d88af9e-b6f1-424f-9b3c-d48b5ceac60d tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1315 microversion: 2.1 time: 0.519710 Jun 03 09:58:42.665578 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 33/69] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:42 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1315 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:42.681809 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-f2b138fc-50a7-42bf-a00b-7cda387aec9b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:42.683797 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-f2b138fc-50a7-42bf-a00b-7cda387aec9b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:42.685175 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-0e3ce4e2-0587-4617-a13e-25c2b2e741eb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1298 microversion: 2.1 time: 0.132443 Jun 03 09:58:42.686141 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 37/70] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:42 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1298 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:58:42.697202 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f2b138fc-50a7-42bf-a00b-7cda387aec9b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:42.699078 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f2b138fc-50a7-42bf-a00b-7cda387aec9b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:42.700510 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f2b138fc-50a7-42bf-a00b-7cda387aec9b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:42.701534 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f2b138fc-50a7-42bf-a00b-7cda387aec9b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:42.748662 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-bdd44028-e140-49d1-ae8e-e61f3ac48c7f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:42.750420 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-bdd44028-e140-49d1-ae8e-e61f3ac48c7f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:42.824350 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-bdd44028-e140-49d1-ae8e-e61f3ac48c7f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:42.834383 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-bdd44028-e140-49d1-ae8e-e61f3ac48c7f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:42.837533 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-bdd44028-e140-49d1-ae8e-e61f3ac48c7f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:42.838946 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-bdd44028-e140-49d1-ae8e-e61f3ac48c7f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1281 microversion: 2.20 time: 0.095546 Jun 03 09:58:42.839962 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 38/71] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 09:58:42 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1281 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:58:42.900821 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-f2b138fc-50a7-42bf-a00b-7cda387aec9b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:42.929349 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-f2b138fc-50a7-42bf-a00b-7cda387aec9b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1321 microversion: 2.1 time: 0.260303 Jun 03 09:58:42.929349 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 34/72] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:42 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1321 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:43.646342 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-b6e96686-89d6-4d69-827b-96d65ed11c21 req-c0706897-c977-4f9b-a212-c6676336172a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "268a2ebf-7c18-40e4-85fb-edf05a174e1d", "tag": "bdc90016-2ff6-4553-a6ad-1bfc7f7efb08"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:58:43.657875 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-b6e96686-89d6-4d69-827b-96d65ed11c21 req-c0706897-c977-4f9b-a212-c6676336172a service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:43.658464 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-b6e96686-89d6-4d69-827b-96d65ed11c21 req-c0706897-c977-4f9b-a212-c6676336172a service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:43.670824 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-b6e96686-89d6-4d69-827b-96d65ed11c21 req-c0706897-c977-4f9b-a212-c6676336172a service nova] Creating event network-changed:bdc90016-2ff6-4553-a6ad-1bfc7f7efb08 for instance 268a2ebf-7c18-40e4-85fb-edf05a174e1d on hv-cinder-84456 Jun 03 09:58:43.682183 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-b6e96686-89d6-4d69-827b-96d65ed11c21 req-c0706897-c977-4f9b-a212-c6676336172a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033517 Jun 03 09:58:43.683161 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-ff341e46-7eb0-49b5-8a24-22a37bda4906 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:43.684338 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-ff341e46-7eb0-49b5-8a24-22a37bda4906 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:43.684595 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 39/73] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 09:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:58:43.692547 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ff341e46-7eb0-49b5-8a24-22a37bda4906 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:43.693247 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ff341e46-7eb0-49b5-8a24-22a37bda4906 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:43.694254 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ff341e46-7eb0-49b5-8a24-22a37bda4906 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:43.694846 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ff341e46-7eb0-49b5-8a24-22a37bda4906 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:43.706056 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-a721226a-708e-4cc4-beee-a0132604cd21 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:43.706856 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-a721226a-708e-4cc4-beee-a0132604cd21 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:43.724469 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a721226a-708e-4cc4-beee-a0132604cd21 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:43.725020 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a721226a-708e-4cc4-beee-a0132604cd21 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:43.725865 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a721226a-708e-4cc4-beee-a0132604cd21 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:43.726406 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a721226a-708e-4cc4-beee-a0132604cd21 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:43.889846 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-a721226a-708e-4cc4-beee-a0132604cd21 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:43.898135 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-a721226a-708e-4cc4-beee-a0132604cd21 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1296 microversion: 2.1 time: 0.196219 Jun 03 09:58:43.908646 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 40/74] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:43 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1296 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:43.913784 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-5063e36c-6073-4ea4-96b1-c5a10415854c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:43.914635 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-5063e36c-6073-4ea4-96b1-c5a10415854c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:43.922339 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5063e36c-6073-4ea4-96b1-c5a10415854c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:43.923051 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5063e36c-6073-4ea4-96b1-c5a10415854c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:43.923980 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5063e36c-6073-4ea4-96b1-c5a10415854c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:43.924566 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5063e36c-6073-4ea4-96b1-c5a10415854c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:44.087685 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-5063e36c-6073-4ea4-96b1-c5a10415854c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:44.101467 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-5063e36c-6073-4ea4-96b1-c5a10415854c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:44.103164 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-5063e36c-6073-4ea4-96b1-c5a10415854c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:44.104622 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-5063e36c-6073-4ea4-96b1-c5a10415854c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1333 microversion: 2.20 time: 0.194597 Jun 03 09:58:44.105256 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 41/75] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 09:58:43 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1333 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:58:44.110118 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-b11479cb-11a1-4f9d-b824-6740e2f4dec6 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:44.110774 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-b11479cb-11a1-4f9d-b824-6740e2f4dec6 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:44.119012 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b11479cb-11a1-4f9d-b824-6740e2f4dec6 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:44.119771 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b11479cb-11a1-4f9d-b824-6740e2f4dec6 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:44.122298 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b11479cb-11a1-4f9d-b824-6740e2f4dec6 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:44.123128 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b11479cb-11a1-4f9d-b824-6740e2f4dec6 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:44.196191 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-ff341e46-7eb0-49b5-8a24-22a37bda4906 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:44.205454 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-ff341e46-7eb0-49b5-8a24-22a37bda4906 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1315 microversion: 2.1 time: 0.526490 Jun 03 09:58:44.210939 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 35/76] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:43 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1315 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:44.352326 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-b11479cb-11a1-4f9d-b824-6740e2f4dec6 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:44.361785 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-b11479cb-11a1-4f9d-b824-6740e2f4dec6 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1321 microversion: 2.1 time: 0.255271 Jun 03 09:58:44.362408 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 42/77] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:44 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:44.917679 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-6f102d54-2fd5-4c9c-8d48-2229655c64f2 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:44.918208 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-6f102d54-2fd5-4c9c-8d48-2229655c64f2 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:44.934895 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6f102d54-2fd5-4c9c-8d48-2229655c64f2 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:44.938019 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6f102d54-2fd5-4c9c-8d48-2229655c64f2 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:44.939164 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6f102d54-2fd5-4c9c-8d48-2229655c64f2 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:44.939751 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6f102d54-2fd5-4c9c-8d48-2229655c64f2 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:45.124315 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-51b791df-7757-4b5a-8491-891421b14d59 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:45.124981 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-51b791df-7757-4b5a-8491-891421b14d59 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:45.138440 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-51b791df-7757-4b5a-8491-891421b14d59 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:45.138440 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-51b791df-7757-4b5a-8491-891421b14d59 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:45.138440 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-51b791df-7757-4b5a-8491-891421b14d59 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:45.138440 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-51b791df-7757-4b5a-8491-891421b14d59 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:45.726568 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-51b791df-7757-4b5a-8491-891421b14d59 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:45.742613 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-51b791df-7757-4b5a-8491-891421b14d59 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:45.744295 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-51b791df-7757-4b5a-8491-891421b14d59 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:45.746867 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-51b791df-7757-4b5a-8491-891421b14d59 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1341 microversion: 2.20 time: 0.627867 Jun 03 09:58:45.747909 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 43/78] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 09:58:45 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1341 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:58:45.755002 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-630684f8-2502-4857-af9f-dbfb13dfff97 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:45.755002 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-630684f8-2502-4857-af9f-dbfb13dfff97 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:45.760485 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-630684f8-2502-4857-af9f-dbfb13dfff97 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:45.761244 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-630684f8-2502-4857-af9f-dbfb13dfff97 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:45.762248 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-630684f8-2502-4857-af9f-dbfb13dfff97 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:45.763150 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-630684f8-2502-4857-af9f-dbfb13dfff97 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:45.765526 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-6f102d54-2fd5-4c9c-8d48-2229655c64f2 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:45.773693 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-6f102d54-2fd5-4c9c-8d48-2229655c64f2 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1364 microversion: 2.1 time: 0.861435 Jun 03 09:58:45.777844 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 36/79] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:44 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1364 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:45.790023 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-e79fa07f-9018-4a38-a043-2227736cab6e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:45.790897 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-e79fa07f-9018-4a38-a043-2227736cab6e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:45.809607 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e79fa07f-9018-4a38-a043-2227736cab6e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:45.810153 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e79fa07f-9018-4a38-a043-2227736cab6e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:45.810912 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e79fa07f-9018-4a38-a043-2227736cab6e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:45.811409 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e79fa07f-9018-4a38-a043-2227736cab6e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:46.294550 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-630684f8-2502-4857-af9f-dbfb13dfff97 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:46.299993 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-e79fa07f-9018-4a38-a043-2227736cab6e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:46.302267 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-630684f8-2502-4857-af9f-dbfb13dfff97 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1315 microversion: 2.1 time: 0.553153 Jun 03 09:58:46.303076 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 44/80] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:45 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1315 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:46.312552 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-e79fa07f-9018-4a38-a043-2227736cab6e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1321 microversion: 2.1 time: 0.533417 Jun 03 09:58:46.313177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 37/81] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:45 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1321 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:46.773663 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-f6ecd9db-c1fe-4316-b449-d7dd14cafa91 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:46.774624 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-f6ecd9db-c1fe-4316-b449-d7dd14cafa91 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:46.783823 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f6ecd9db-c1fe-4316-b449-d7dd14cafa91 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:46.785110 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f6ecd9db-c1fe-4316-b449-d7dd14cafa91 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:46.788275 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f6ecd9db-c1fe-4316-b449-d7dd14cafa91 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:46.798442 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-bacdfef6-5b7c-4b71-a015-62c9070d51bf tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:46.799980 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f6ecd9db-c1fe-4316-b449-d7dd14cafa91 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:46.800253 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-bacdfef6-5b7c-4b71-a015-62c9070d51bf tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:46.813639 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bacdfef6-5b7c-4b71-a015-62c9070d51bf tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:46.815002 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bacdfef6-5b7c-4b71-a015-62c9070d51bf tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:46.818911 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bacdfef6-5b7c-4b71-a015-62c9070d51bf tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:46.819461 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bacdfef6-5b7c-4b71-a015-62c9070d51bf tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:46.997835 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f6ecd9db-c1fe-4316-b449-d7dd14cafa91 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:47.006678 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f6ecd9db-c1fe-4316-b449-d7dd14cafa91 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:47.008533 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f6ecd9db-c1fe-4316-b449-d7dd14cafa91 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:47.009637 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-f6ecd9db-c1fe-4316-b449-d7dd14cafa91 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1339 microversion: 2.20 time: 0.242120 Jun 03 09:58:47.010860 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 45/82] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 09:58:46 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1339 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:58:47.200425 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-bacdfef6-5b7c-4b71-a015-62c9070d51bf tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:47.211642 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-bacdfef6-5b7c-4b71-a015-62c9070d51bf tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1364 microversion: 2.1 time: 0.421588 Jun 03 09:58:47.226807 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 38/83] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:46 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1364 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:58:47.320659 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-fe2591f9-1a95-4fc4-8afb-9fd21b78d4be tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:47.327999 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-fe2591f9-1a95-4fc4-8afb-9fd21b78d4be tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:47.329792 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-ec6b8269-25e5-47d4-9fd8-ebe3af2c5d65 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:47.330598 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-ec6b8269-25e5-47d4-9fd8-ebe3af2c5d65 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:47.334724 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-fe2591f9-1a95-4fc4-8afb-9fd21b78d4be tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:47.335210 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-fe2591f9-1a95-4fc4-8afb-9fd21b78d4be tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:47.336032 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-fe2591f9-1a95-4fc4-8afb-9fd21b78d4be tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:47.336471 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-fe2591f9-1a95-4fc4-8afb-9fd21b78d4be tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:47.344849 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ec6b8269-25e5-47d4-9fd8-ebe3af2c5d65 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:47.345383 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ec6b8269-25e5-47d4-9fd8-ebe3af2c5d65 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:47.346316 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ec6b8269-25e5-47d4-9fd8-ebe3af2c5d65 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:47.346857 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ec6b8269-25e5-47d4-9fd8-ebe3af2c5d65 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:47.832747 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-ec6b8269-25e5-47d4-9fd8-ebe3af2c5d65 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:47.842015 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-ec6b8269-25e5-47d4-9fd8-ebe3af2c5d65 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1321 microversion: 2.1 time: 0.517127 Jun 03 09:58:47.852179 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 39/84] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:47 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1321 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:47.906249 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-fe2591f9-1a95-4fc4-8afb-9fd21b78d4be tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:47.910572 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=100 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:47.918687 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-fe2591f9-1a95-4fc4-8afb-9fd21b78d4be tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1315 microversion: 2.1 time: 0.603155 Jun 03 09:58:47.921301 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 46/85] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:47 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1315 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:47.940834 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-62c83f2a-9fcb-4b38-bd27-723aea45c438 req-41a08644-de95-48ea-978f-50cb8a11d79b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fee24c1-4a54-47e9-9a0a-0726af3cf00a", "name": "network-vif-plugged", "status": "completed", "tag": "7f22a49d-b6ec-4dd7-93b2-f7ec2f927c22"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:58:47.949617 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-62c83f2a-9fcb-4b38-bd27-723aea45c438 req-41a08644-de95-48ea-978f-50cb8a11d79b service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:47.950091 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-62c83f2a-9fcb-4b38-bd27-723aea45c438 req-41a08644-de95-48ea-978f-50cb8a11d79b service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:47.961231 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-62c83f2a-9fcb-4b38-bd27-723aea45c438 req-41a08644-de95-48ea-978f-50cb8a11d79b service nova] Creating event network-vif-plugged:7f22a49d-b6ec-4dd7-93b2-f7ec2f927c22 for instance 0fee24c1-4a54-47e9-9a0a-0726af3cf00a on hv-cinder-84456 Jun 03 09:58:47.966385 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-62c83f2a-9fcb-4b38-bd27-723aea45c438 req-41a08644-de95-48ea-978f-50cb8a11d79b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112784 Jun 03 09:58:47.967070 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 40/86] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 09:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:58:48.032791 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-121bdf5c-1b4a-4d09-90c6-5fdce0c32ea6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:48.033416 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-121bdf5c-1b4a-4d09-90c6-5fdce0c32ea6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:48.041823 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-121bdf5c-1b4a-4d09-90c6-5fdce0c32ea6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:48.042863 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-121bdf5c-1b4a-4d09-90c6-5fdce0c32ea6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:48.043788 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-121bdf5c-1b4a-4d09-90c6-5fdce0c32ea6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:48.044534 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-121bdf5c-1b4a-4d09-90c6-5fdce0c32ea6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:48.067213 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-92625dd7-ae51-45de-a670-904dcac7a21f req-495a5944-7d60-4d94-8f08-a8adb4a00c49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22d7bf3d-d6e9-4a78-bf74-77b44928b1d3", "tag": "5e8649fd-c65a-45e0-87b5-6023ff2fceaf"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:58:48.074589 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-92625dd7-ae51-45de-a670-904dcac7a21f req-495a5944-7d60-4d94-8f08-a8adb4a00c49 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:48.076081 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-92625dd7-ae51-45de-a670-904dcac7a21f req-495a5944-7d60-4d94-8f08-a8adb4a00c49 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:48.119184 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-92625dd7-ae51-45de-a670-904dcac7a21f req-495a5944-7d60-4d94-8f08-a8adb4a00c49 service nova] Creating event network-changed:5e8649fd-c65a-45e0-87b5-6023ff2fceaf for instance 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 on hv-cinder-84456 Jun 03 09:58:48.141324 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-121bdf5c-1b4a-4d09-90c6-5fdce0c32ea6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:48.153181 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-121bdf5c-1b4a-4d09-90c6-5fdce0c32ea6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:48.157164 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-121bdf5c-1b4a-4d09-90c6-5fdce0c32ea6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:48.157904 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-92625dd7-ae51-45de-a670-904dcac7a21f req-495a5944-7d60-4d94-8f08-a8adb4a00c49 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071458 Jun 03 09:58:48.158957 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-121bdf5c-1b4a-4d09-90c6-5fdce0c32ea6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1339 microversion: 2.20 time: 0.131493 Jun 03 09:58:48.160080 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 47/87] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 09:58:48 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1339 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:58:48.164837 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 41/88] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 09:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:58:48.233919 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-0570eb16-04cc-44ce-bae9-be561caf0125 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:48.234534 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-0570eb16-04cc-44ce-bae9-be561caf0125 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:48.246889 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0570eb16-04cc-44ce-bae9-be561caf0125 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:48.247555 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0570eb16-04cc-44ce-bae9-be561caf0125 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:48.248463 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0570eb16-04cc-44ce-bae9-be561caf0125 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:48.249035 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0570eb16-04cc-44ce-bae9-be561caf0125 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:48.856705 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell0:SELECT=30 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:48.861691 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-7083db52-0348-4b07-8cd2-474d8a880c1d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:48.862418 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-7083db52-0348-4b07-8cd2-474d8a880c1d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:48.892235 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7083db52-0348-4b07-8cd2-474d8a880c1d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:48.896314 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7083db52-0348-4b07-8cd2-474d8a880c1d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:48.897870 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7083db52-0348-4b07-8cd2-474d8a880c1d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:48.900931 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7083db52-0348-4b07-8cd2-474d8a880c1d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:49.053218 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-0570eb16-04cc-44ce-bae9-be561caf0125 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:49.070895 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-0570eb16-04cc-44ce-bae9-be561caf0125 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1364 microversion: 2.1 time: 0.840610 Jun 03 09:58:49.071829 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 48/89] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:48 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1364 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:49.076789 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-0edbb3d1-dde8-4d66-9ea3-17f52ee34eb0 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:49.077569 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-0edbb3d1-dde8-4d66-9ea3-17f52ee34eb0 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:49.089937 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0edbb3d1-dde8-4d66-9ea3-17f52ee34eb0 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:49.090469 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0edbb3d1-dde8-4d66-9ea3-17f52ee34eb0 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:49.091260 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0edbb3d1-dde8-4d66-9ea3-17f52ee34eb0 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:49.091700 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0edbb3d1-dde8-4d66-9ea3-17f52ee34eb0 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:49.464558 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-7083db52-0348-4b07-8cd2-474d8a880c1d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:49.476434 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-7083db52-0348-4b07-8cd2-474d8a880c1d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1321 microversion: 2.1 time: 0.620433 Jun 03 09:58:49.478384 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 42/90] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:48 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1321 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:49.484990 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-03da1a1b-2d13-423e-8294-ad29daa82c51 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:49.485797 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-03da1a1b-2d13-423e-8294-ad29daa82c51 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:49.493228 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-03da1a1b-2d13-423e-8294-ad29daa82c51 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:49.494145 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-03da1a1b-2d13-423e-8294-ad29daa82c51 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:49.498863 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-03da1a1b-2d13-423e-8294-ad29daa82c51 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:49.505711 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-0edbb3d1-dde8-4d66-9ea3-17f52ee34eb0 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:49.506887 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-03da1a1b-2d13-423e-8294-ad29daa82c51 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:49.519914 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-0edbb3d1-dde8-4d66-9ea3-17f52ee34eb0 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1315 microversion: 2.1 time: 0.446373 Jun 03 09:58:49.524530 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 49/91] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:49 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:49.846749 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-03da1a1b-2d13-423e-8294-ad29daa82c51 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:49.860031 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-03da1a1b-2d13-423e-8294-ad29daa82c51 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:49.861741 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-03da1a1b-2d13-423e-8294-ad29daa82c51 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:49.862943 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-03da1a1b-2d13-423e-8294-ad29daa82c51 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1406 microversion: 2.20 time: 0.382354 Jun 03 09:58:49.863605 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 43/92] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 09:58:49 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1406 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:58:49.982173 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-0ec7b358-72bf-4cf7-8f73-c0cc0fb88a4b req-8fc9e30c-c120-437c-adc5-2e81cef9790b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28ff128f-ff5e-4889-9f83-bdfb4b86a83d", "name": "network-vif-plugged", "status": "completed", "tag": "d8e80358-de18-46e9-b759-6c8d92fd7f83"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:58:49.990008 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-0ec7b358-72bf-4cf7-8f73-c0cc0fb88a4b req-8fc9e30c-c120-437c-adc5-2e81cef9790b service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:49.990454 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-0ec7b358-72bf-4cf7-8f73-c0cc0fb88a4b req-8fc9e30c-c120-437c-adc5-2e81cef9790b service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:50.001789 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-0ec7b358-72bf-4cf7-8f73-c0cc0fb88a4b req-8fc9e30c-c120-437c-adc5-2e81cef9790b service nova] Creating event network-vif-plugged:d8e80358-de18-46e9-b759-6c8d92fd7f83 for instance 28ff128f-ff5e-4889-9f83-bdfb4b86a83d on hv-cinder-84456 Jun 03 09:58:50.006777 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-0ec7b358-72bf-4cf7-8f73-c0cc0fb88a4b req-8fc9e30c-c120-437c-adc5-2e81cef9790b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028685 Jun 03 09:58:50.010677 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 50/93] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 09:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:58:50.089221 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-da7d48b6-d781-4ef3-8ff8-4e0c5eb329fb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:50.090385 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-da7d48b6-d781-4ef3-8ff8-4e0c5eb329fb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:50.104311 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-da7d48b6-d781-4ef3-8ff8-4e0c5eb329fb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:50.104983 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-da7d48b6-d781-4ef3-8ff8-4e0c5eb329fb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:50.106492 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-da7d48b6-d781-4ef3-8ff8-4e0c5eb329fb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:50.107035 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-da7d48b6-d781-4ef3-8ff8-4e0c5eb329fb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:50.332326 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-da7d48b6-d781-4ef3-8ff8-4e0c5eb329fb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:50.340281 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-da7d48b6-d781-4ef3-8ff8-4e0c5eb329fb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1364 microversion: 2.1 time: 0.256991 Jun 03 09:58:50.340947 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 44/94] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:50 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1364 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:50.440188 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-b3217c5a-6ff8-461b-8485-e5f7257fe2f7 req-d6bca211-dcde-42e1-96bd-80dd8bf6f783 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6517823d-711a-4e24-9cdf-27812d522a46", "tag": "a93886de-f812-40e6-81ba-b35e06454a66"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:58:50.454453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-b3217c5a-6ff8-461b-8485-e5f7257fe2f7 req-d6bca211-dcde-42e1-96bd-80dd8bf6f783 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:50.454917 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-b3217c5a-6ff8-461b-8485-e5f7257fe2f7 req-d6bca211-dcde-42e1-96bd-80dd8bf6f783 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:50.480973 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-b3217c5a-6ff8-461b-8485-e5f7257fe2f7 req-d6bca211-dcde-42e1-96bd-80dd8bf6f783 service nova] Creating event network-changed:a93886de-f812-40e6-81ba-b35e06454a66 for instance 6517823d-711a-4e24-9cdf-27812d522a46 on hv-cinder-84456 Jun 03 09:58:50.494598 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-0988eea6-4db1-46d8-a142-6953b32ec0c9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:50.496413 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-0988eea6-4db1-46d8-a142-6953b32ec0c9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:50.502519 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-b3217c5a-6ff8-461b-8485-e5f7257fe2f7 req-d6bca211-dcde-42e1-96bd-80dd8bf6f783 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065316 Jun 03 09:58:50.511195 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 51/95] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 09:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:58:50.511645 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell0:SELECT=6 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:50.515572 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0988eea6-4db1-46d8-a142-6953b32ec0c9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:50.516049 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0988eea6-4db1-46d8-a142-6953b32ec0c9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:50.516794 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0988eea6-4db1-46d8-a142-6953b32ec0c9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:50.517227 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0988eea6-4db1-46d8-a142-6953b32ec0c9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:50.539253 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-f7dbbc72-aa96-4a62-b395-cb189633a0c4 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:50.541441 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-f7dbbc72-aa96-4a62-b395-cb189633a0c4 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:50.551703 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f7dbbc72-aa96-4a62-b395-cb189633a0c4 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:50.552328 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f7dbbc72-aa96-4a62-b395-cb189633a0c4 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:50.553155 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f7dbbc72-aa96-4a62-b395-cb189633a0c4 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:50.553602 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f7dbbc72-aa96-4a62-b395-cb189633a0c4 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:50.760163 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-0988eea6-4db1-46d8-a142-6953b32ec0c9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:50.764315 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f7dbbc72-aa96-4a62-b395-cb189633a0c4 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:50.768758 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-0988eea6-4db1-46d8-a142-6953b32ec0c9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1321 microversion: 2.1 time: 0.278219 Jun 03 09:58:50.769338 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 45/96] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:50 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1321 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:58:50.772919 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-f7dbbc72-aa96-4a62-b395-cb189633a0c4 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1315 microversion: 2.1 time: 0.238834 Jun 03 09:58:50.773488 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 52/97] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:50 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:50.883072 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-1187da54-b10b-4c81-ae21-42cff37bf3e3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:50.883675 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-1187da54-b10b-4c81-ae21-42cff37bf3e3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:50.890675 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1187da54-b10b-4c81-ae21-42cff37bf3e3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:50.891122 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1187da54-b10b-4c81-ae21-42cff37bf3e3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:50.891868 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1187da54-b10b-4c81-ae21-42cff37bf3e3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:50.892295 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1187da54-b10b-4c81-ae21-42cff37bf3e3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:50.897103 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:SELECT=100 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:51.162831 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-1187da54-b10b-4c81-ae21-42cff37bf3e3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:51.170741 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-1187da54-b10b-4c81-ae21-42cff37bf3e3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:51.172343 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-1187da54-b10b-4c81-ae21-42cff37bf3e3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:51.173517 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-1187da54-b10b-4c81-ae21-42cff37bf3e3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1406 microversion: 2.20 time: 0.294293 Jun 03 09:58:51.174113 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 46/98] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 09:58:50 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1406 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:58:51.356474 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-4894d516-f9ba-42c4-af6d-efc38cd50668 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:51.357088 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-4894d516-f9ba-42c4-af6d-efc38cd50668 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:51.359309 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell0:SELECT=6 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:51.364105 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4894d516-f9ba-42c4-af6d-efc38cd50668 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:51.364548 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4894d516-f9ba-42c4-af6d-efc38cd50668 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:51.365303 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4894d516-f9ba-42c4-af6d-efc38cd50668 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:51.365727 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4894d516-f9ba-42c4-af6d-efc38cd50668 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:51.494385 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-4894d516-f9ba-42c4-af6d-efc38cd50668 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:51.502380 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-4894d516-f9ba-42c4-af6d-efc38cd50668 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1364 microversion: 2.1 time: 0.149813 Jun 03 09:58:51.508510 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 53/99] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:51 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:51.784838 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-b26b9789-9cbe-481b-b36d-b7a17bab33db tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:51.785372 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-b26b9789-9cbe-481b-b36d-b7a17bab33db tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:51.789809 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-f83487a3-1a53-4f62-b15b-964f3df3e0c6 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:51.790591 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-f83487a3-1a53-4f62-b15b-964f3df3e0c6 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:51.792439 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b26b9789-9cbe-481b-b36d-b7a17bab33db tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:51.792996 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b26b9789-9cbe-481b-b36d-b7a17bab33db tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:51.793840 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b26b9789-9cbe-481b-b36d-b7a17bab33db tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:51.794459 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b26b9789-9cbe-481b-b36d-b7a17bab33db tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:51.799648 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f83487a3-1a53-4f62-b15b-964f3df3e0c6 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:51.799648 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f83487a3-1a53-4f62-b15b-964f3df3e0c6 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:51.799648 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f83487a3-1a53-4f62-b15b-964f3df3e0c6 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:51.799648 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f83487a3-1a53-4f62-b15b-964f3df3e0c6 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:51.982102 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-b26b9789-9cbe-481b-b36d-b7a17bab33db tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:51.989722 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-b26b9789-9cbe-481b-b36d-b7a17bab33db tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1321 microversion: 2.1 time: 0.209112 Jun 03 09:58:51.990778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 47/100] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:51 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:51.993738 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f83487a3-1a53-4f62-b15b-964f3df3e0c6 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:52.001481 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-f83487a3-1a53-4f62-b15b-964f3df3e0c6 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1315 microversion: 2.1 time: 0.215729 Jun 03 09:58:52.002077 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 54/101] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:51 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:58:52.191251 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-b89daf62-4ef7-4025-bdfa-1901147fba06 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:52.191945 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-b89daf62-4ef7-4025-bdfa-1901147fba06 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:52.197976 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b89daf62-4ef7-4025-bdfa-1901147fba06 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:52.199080 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b89daf62-4ef7-4025-bdfa-1901147fba06 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:52.199840 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b89daf62-4ef7-4025-bdfa-1901147fba06 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:52.200306 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b89daf62-4ef7-4025-bdfa-1901147fba06 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:52.347975 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-b89daf62-4ef7-4025-bdfa-1901147fba06 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:52.356431 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-b89daf62-4ef7-4025-bdfa-1901147fba06 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:52.358113 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-b89daf62-4ef7-4025-bdfa-1901147fba06 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:52.359218 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-b89daf62-4ef7-4025-bdfa-1901147fba06 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1406 microversion: 2.20 time: 0.171854 Jun 03 09:58:52.359902 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 48/102] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 09:58:52 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:58:52.521537 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-f2a554f4-d18b-4f8f-846e-77ed24b379a3 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:52.522494 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-f2a554f4-d18b-4f8f-846e-77ed24b379a3 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:52.530209 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f2a554f4-d18b-4f8f-846e-77ed24b379a3 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:52.530525 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f2a554f4-d18b-4f8f-846e-77ed24b379a3 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:52.531490 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f2a554f4-d18b-4f8f-846e-77ed24b379a3 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:52.532363 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f2a554f4-d18b-4f8f-846e-77ed24b379a3 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:52.727661 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f2a554f4-d18b-4f8f-846e-77ed24b379a3 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:52.735595 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-f2a554f4-d18b-4f8f-846e-77ed24b379a3 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1364 microversion: 2.1 time: 0.220461 Jun 03 09:58:52.736157 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 55/103] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:52 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:53.006761 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-099259e1-6592-497d-8b7a-1ff30faacf19 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:53.007372 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-099259e1-6592-497d-8b7a-1ff30faacf19 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:53.013618 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-099259e1-6592-497d-8b7a-1ff30faacf19 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:53.014109 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-099259e1-6592-497d-8b7a-1ff30faacf19 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:53.014866 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-099259e1-6592-497d-8b7a-1ff30faacf19 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:53.015308 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-099259e1-6592-497d-8b7a-1ff30faacf19 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:53.018650 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-a522961c-a8d8-4f68-a33b-9598cd6217e2 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:53.019470 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-a522961c-a8d8-4f68-a33b-9598cd6217e2 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:53.021658 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell0:SELECT=3 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:53.027309 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a522961c-a8d8-4f68-a33b-9598cd6217e2 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:53.027792 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a522961c-a8d8-4f68-a33b-9598cd6217e2 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:53.028562 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a522961c-a8d8-4f68-a33b-9598cd6217e2 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:53.029295 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a522961c-a8d8-4f68-a33b-9598cd6217e2 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:53.211256 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-099259e1-6592-497d-8b7a-1ff30faacf19 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:53.215902 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-a522961c-a8d8-4f68-a33b-9598cd6217e2 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:53.222641 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-099259e1-6592-497d-8b7a-1ff30faacf19 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1321 microversion: 2.1 time: 0.217179 Jun 03 09:58:53.222641 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 49/104] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:53 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:53.224068 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-a522961c-a8d8-4f68-a33b-9598cd6217e2 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1315 microversion: 2.1 time: 0.209531 Jun 03 09:58:53.224634 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 56/105] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:53 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:58:53.376557 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-d44cdc36-1703-43bc-b578-85f0c0ab90cf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:53.377136 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-d44cdc36-1703-43bc-b578-85f0c0ab90cf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:53.383357 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d44cdc36-1703-43bc-b578-85f0c0ab90cf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:53.383810 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d44cdc36-1703-43bc-b578-85f0c0ab90cf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:53.384576 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d44cdc36-1703-43bc-b578-85f0c0ab90cf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:53.385044 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d44cdc36-1703-43bc-b578-85f0c0ab90cf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:53.516545 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-d44cdc36-1703-43bc-b578-85f0c0ab90cf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:53.524616 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-d44cdc36-1703-43bc-b578-85f0c0ab90cf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:53.526790 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-d44cdc36-1703-43bc-b578-85f0c0ab90cf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:53.527919 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-d44cdc36-1703-43bc-b578-85f0c0ab90cf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1406 microversion: 2.20 time: 0.155307 Jun 03 09:58:53.528524 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 50/106] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 09:58:53 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:58:53.752405 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-8ec10ad8-1b6a-4186-b045-fc7e65409225 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:53.753078 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-8ec10ad8-1b6a-4186-b045-fc7e65409225 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:53.759328 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8ec10ad8-1b6a-4186-b045-fc7e65409225 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:53.759770 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8ec10ad8-1b6a-4186-b045-fc7e65409225 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:53.760575 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8ec10ad8-1b6a-4186-b045-fc7e65409225 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:53.761527 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8ec10ad8-1b6a-4186-b045-fc7e65409225 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:53.890160 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-8ec10ad8-1b6a-4186-b045-fc7e65409225 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:53.897644 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-8ec10ad8-1b6a-4186-b045-fc7e65409225 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1364 microversion: 2.1 time: 0.149039 Jun 03 09:58:53.898249 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 57/107] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:53 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:54.236273 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-b9f2f237-b4ac-4cd5-a515-45d10e000ffb tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:54.237155 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-b9f2f237-b4ac-4cd5-a515-45d10e000ffb tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:54.241428 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-307de7df-aeab-4d52-8f4b-19badc170003 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:54.242333 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-307de7df-aeab-4d52-8f4b-19badc170003 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:54.243211 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b9f2f237-b4ac-4cd5-a515-45d10e000ffb tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:54.243766 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b9f2f237-b4ac-4cd5-a515-45d10e000ffb tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:54.244540 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b9f2f237-b4ac-4cd5-a515-45d10e000ffb tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:54.249985 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b9f2f237-b4ac-4cd5-a515-45d10e000ffb tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:54.250098 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-307de7df-aeab-4d52-8f4b-19badc170003 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:54.250098 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-307de7df-aeab-4d52-8f4b-19badc170003 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:54.250759 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-307de7df-aeab-4d52-8f4b-19badc170003 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:54.251207 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-307de7df-aeab-4d52-8f4b-19badc170003 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:54.434305 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-b9f2f237-b4ac-4cd5-a515-45d10e000ffb tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:54.442486 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-b9f2f237-b4ac-4cd5-a515-45d10e000ffb tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1321 microversion: 2.1 time: 0.209949 Jun 03 09:58:54.445553 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-307de7df-aeab-4d52-8f4b-19badc170003 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:54.446674 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 51/108] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:54 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:54.453572 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-307de7df-aeab-4d52-8f4b-19badc170003 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1315 microversion: 2.1 time: 0.217017 Jun 03 09:58:54.454173 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 58/109] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:54 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:58:54.546511 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-57512722-07cf-4374-97b2-ea197dc57d6a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:54.547120 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-57512722-07cf-4374-97b2-ea197dc57d6a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:54.553071 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-57512722-07cf-4374-97b2-ea197dc57d6a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:54.553521 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-57512722-07cf-4374-97b2-ea197dc57d6a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:54.554298 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-57512722-07cf-4374-97b2-ea197dc57d6a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:54.554733 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-57512722-07cf-4374-97b2-ea197dc57d6a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:54.687792 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-57512722-07cf-4374-97b2-ea197dc57d6a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:54.695013 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-57512722-07cf-4374-97b2-ea197dc57d6a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:54.697871 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-57512722-07cf-4374-97b2-ea197dc57d6a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:54.697871 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-57512722-07cf-4374-97b2-ea197dc57d6a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1406 microversion: 2.20 time: 0.155740 Jun 03 09:58:54.708271 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 52/110] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 09:58:54 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:58:54.914928 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-520fca5d-b9f2-461f-beaf-a81be49e7b74 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:54.915463 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-520fca5d-b9f2-461f-beaf-a81be49e7b74 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:54.921463 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-520fca5d-b9f2-461f-beaf-a81be49e7b74 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:54.921942 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-520fca5d-b9f2-461f-beaf-a81be49e7b74 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:54.922709 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-520fca5d-b9f2-461f-beaf-a81be49e7b74 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:54.923145 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-520fca5d-b9f2-461f-beaf-a81be49e7b74 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:55.051933 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-520fca5d-b9f2-461f-beaf-a81be49e7b74 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:55.060278 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-520fca5d-b9f2-461f-beaf-a81be49e7b74 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1364 microversion: 2.1 time: 0.149395 Jun 03 09:58:55.060847 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 59/111] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:54 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:55.462351 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-528286e1-9713-4e0d-b26f-76f15ae5cd2f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:55.463228 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-528286e1-9713-4e0d-b26f-76f15ae5cd2f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:55.471682 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-528286e1-9713-4e0d-b26f-76f15ae5cd2f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:55.472293 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-528286e1-9713-4e0d-b26f-76f15ae5cd2f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:55.473451 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-528286e1-9713-4e0d-b26f-76f15ae5cd2f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:55.474096 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-528286e1-9713-4e0d-b26f-76f15ae5cd2f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:55.474580 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-882fced7-7e4a-47fb-bc3b-cbb9b1551890 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:55.476246 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-882fced7-7e4a-47fb-bc3b-cbb9b1551890 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:55.485495 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-882fced7-7e4a-47fb-bc3b-cbb9b1551890 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:55.491444 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-882fced7-7e4a-47fb-bc3b-cbb9b1551890 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:55.491444 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-882fced7-7e4a-47fb-bc3b-cbb9b1551890 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:55.491444 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-882fced7-7e4a-47fb-bc3b-cbb9b1551890 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:56.085680 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-528286e1-9713-4e0d-b26f-76f15ae5cd2f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:56.101736 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-882fced7-7e4a-47fb-bc3b-cbb9b1551890 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:56.108610 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-528286e1-9713-4e0d-b26f-76f15ae5cd2f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1321 microversion: 2.1 time: 0.650716 Jun 03 09:58:56.114925 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 53/112] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:55 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1321 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:58:56.128976 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-882fced7-7e4a-47fb-bc3b-cbb9b1551890 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1315 microversion: 2.1 time: 0.661809 Jun 03 09:58:56.129569 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 60/113] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:55 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1315 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:58:56.131029 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-161d6cd1-55a0-4bef-8996-4605540732c9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:56.131645 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-161d6cd1-55a0-4bef-8996-4605540732c9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:56.142788 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-97e475ed-72f6-42c0-8c9f-2994ca9b8fdb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:56.143402 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-97e475ed-72f6-42c0-8c9f-2994ca9b8fdb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:56.146812 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-161d6cd1-55a0-4bef-8996-4605540732c9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:56.147257 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-161d6cd1-55a0-4bef-8996-4605540732c9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:56.148119 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-161d6cd1-55a0-4bef-8996-4605540732c9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:56.148555 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-161d6cd1-55a0-4bef-8996-4605540732c9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:56.156295 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-97e475ed-72f6-42c0-8c9f-2994ca9b8fdb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:56.156775 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-97e475ed-72f6-42c0-8c9f-2994ca9b8fdb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:56.157575 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-97e475ed-72f6-42c0-8c9f-2994ca9b8fdb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:56.160080 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-97e475ed-72f6-42c0-8c9f-2994ca9b8fdb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:56.347318 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-161d6cd1-55a0-4bef-8996-4605540732c9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:56.354013 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-97e475ed-72f6-42c0-8c9f-2994ca9b8fdb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:56.356023 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-161d6cd1-55a0-4bef-8996-4605540732c9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:56.357556 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-161d6cd1-55a0-4bef-8996-4605540732c9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:56.358782 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-161d6cd1-55a0-4bef-8996-4605540732c9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1406 microversion: 2.20 time: 0.240213 Jun 03 09:58:56.359357 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 54/114] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 09:58:56 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:58:56.362031 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-97e475ed-72f6-42c0-8c9f-2994ca9b8fdb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1364 microversion: 2.1 time: 0.227690 Jun 03 09:58:56.362558 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 61/115] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:56 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:57.131570 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-6c8217f6-551f-40f3-8b5c-5bcc62810de1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:57.132256 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-6c8217f6-551f-40f3-8b5c-5bcc62810de1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:57.138677 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6c8217f6-551f-40f3-8b5c-5bcc62810de1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:57.139139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6c8217f6-551f-40f3-8b5c-5bcc62810de1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:57.139900 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6c8217f6-551f-40f3-8b5c-5bcc62810de1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:57.140340 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6c8217f6-551f-40f3-8b5c-5bcc62810de1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:57.146721 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-a6f9cef5-0305-4417-8fa9-70584be73223 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:57.147438 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-a6f9cef5-0305-4417-8fa9-70584be73223 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:57.153342 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a6f9cef5-0305-4417-8fa9-70584be73223 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:57.153996 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a6f9cef5-0305-4417-8fa9-70584be73223 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:57.154669 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a6f9cef5-0305-4417-8fa9-70584be73223 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:57.155105 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a6f9cef5-0305-4417-8fa9-70584be73223 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:57.355150 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-6c8217f6-551f-40f3-8b5c-5bcc62810de1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:57.366740 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-6c8217f6-551f-40f3-8b5c-5bcc62810de1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1321 microversion: 2.1 time: 0.235214 Jun 03 09:58:57.366740 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 55/116] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:57 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:57.367535 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-a6f9cef5-0305-4417-8fa9-70584be73223 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:57.378988 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-9a6d4247-e77d-4b29-99cd-ec33248f6b19 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:57.379673 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-9a6d4247-e77d-4b29-99cd-ec33248f6b19 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:57.380229 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-a6f9cef5-0305-4417-8fa9-70584be73223 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1315 microversion: 2.1 time: 0.237159 Jun 03 09:58:57.381071 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 62/117] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:57 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:58:57.385911 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-971b56b6-b2ca-4bac-8d64-8e3eb1c875c5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:57.386467 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9a6d4247-e77d-4b29-99cd-ec33248f6b19 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:57.386680 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-971b56b6-b2ca-4bac-8d64-8e3eb1c875c5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:57.387038 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9a6d4247-e77d-4b29-99cd-ec33248f6b19 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:57.388064 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9a6d4247-e77d-4b29-99cd-ec33248f6b19 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:57.388494 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9a6d4247-e77d-4b29-99cd-ec33248f6b19 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:57.394192 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-971b56b6-b2ca-4bac-8d64-8e3eb1c875c5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:57.394877 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-971b56b6-b2ca-4bac-8d64-8e3eb1c875c5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:57.395958 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-971b56b6-b2ca-4bac-8d64-8e3eb1c875c5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:57.396807 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-971b56b6-b2ca-4bac-8d64-8e3eb1c875c5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:57.599939 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-9a6d4247-e77d-4b29-99cd-ec33248f6b19 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:57.611328 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-9a6d4247-e77d-4b29-99cd-ec33248f6b19 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:57.613239 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-9a6d4247-e77d-4b29-99cd-ec33248f6b19 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:57.615719 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-9a6d4247-e77d-4b29-99cd-ec33248f6b19 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1406 microversion: 2.20 time: 0.239652 Jun 03 09:58:57.616739 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 56/118] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 09:58:57 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:58:57.640696 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-971b56b6-b2ca-4bac-8d64-8e3eb1c875c5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:57.641281 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-971b56b6-b2ca-4bac-8d64-8e3eb1c875c5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1364 microversion: 2.1 time: 0.259259 Jun 03 09:58:57.641853 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 63/119] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:57 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1364 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:57.672931 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-f08fbd23-0e87-4673-adfd-814ad32672ce req-83509481-ff37-4bbb-a070-9ba68f4511d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "268a2ebf-7c18-40e4-85fb-edf05a174e1d", "name": "network-vif-plugged", "status": "completed", "tag": "bdc90016-2ff6-4553-a6ad-1bfc7f7efb08"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:58:57.681444 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-f08fbd23-0e87-4673-adfd-814ad32672ce req-83509481-ff37-4bbb-a070-9ba68f4511d9 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:57.682082 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-f08fbd23-0e87-4673-adfd-814ad32672ce req-83509481-ff37-4bbb-a070-9ba68f4511d9 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:57.693737 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-f08fbd23-0e87-4673-adfd-814ad32672ce req-83509481-ff37-4bbb-a070-9ba68f4511d9 service nova] Creating event network-vif-plugged:bdc90016-2ff6-4553-a6ad-1bfc7f7efb08 for instance 268a2ebf-7c18-40e4-85fb-edf05a174e1d on hv-cinder-84456 Jun 03 09:58:57.699354 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-f08fbd23-0e87-4673-adfd-814ad32672ce req-83509481-ff37-4bbb-a070-9ba68f4511d9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030591 Jun 03 09:58:57.706532 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 57/120] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 09:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:58:58.382247 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-acf6b017-753d-412a-a1d1-3bf9036e1431 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:58.383966 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-acf6b017-753d-412a-a1d1-3bf9036e1431 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:58.391985 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-acf6b017-753d-412a-a1d1-3bf9036e1431 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:58.392648 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-acf6b017-753d-412a-a1d1-3bf9036e1431 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:58.393615 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-acf6b017-753d-412a-a1d1-3bf9036e1431 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:58.394151 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-acf6b017-753d-412a-a1d1-3bf9036e1431 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:58.397380 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-c4e1caba-0537-4519-bcd4-68857aa042d6 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:58.398050 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-c4e1caba-0537-4519-bcd4-68857aa042d6 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:58.405081 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c4e1caba-0537-4519-bcd4-68857aa042d6 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:58.405545 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c4e1caba-0537-4519-bcd4-68857aa042d6 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:58.406350 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c4e1caba-0537-4519-bcd4-68857aa042d6 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:58.406790 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c4e1caba-0537-4519-bcd4-68857aa042d6 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:58.587636 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-acf6b017-753d-412a-a1d1-3bf9036e1431 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:58.592000 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=100 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:58.595226 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-c4e1caba-0537-4519-bcd4-68857aa042d6 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:58.602113 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-acf6b017-753d-412a-a1d1-3bf9036e1431 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1321 microversion: 2.1 time: 0.224030 Jun 03 09:58:58.603145 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 64/121] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:58 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:58.604307 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-c4e1caba-0537-4519-bcd4-68857aa042d6 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1502 microversion: 2.1 time: 0.210789 Jun 03 09:58:58.605054 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 58/122] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:58 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1502 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:58:58.634680 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-079ecefd-785f-4019-9f3c-a17b9fcbc744 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:58.638510 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-079ecefd-785f-4019-9f3c-a17b9fcbc744 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:58.643987 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-079ecefd-785f-4019-9f3c-a17b9fcbc744 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:58.644717 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-079ecefd-785f-4019-9f3c-a17b9fcbc744 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:58.645768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-079ecefd-785f-4019-9f3c-a17b9fcbc744 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:58.646420 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-079ecefd-785f-4019-9f3c-a17b9fcbc744 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:58.659315 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-0e0b0fe3-5fb9-4d51-a01e-44a0d036ddbb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:58.660036 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-0e0b0fe3-5fb9-4d51-a01e-44a0d036ddbb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:58.667891 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0e0b0fe3-5fb9-4d51-a01e-44a0d036ddbb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:58.673456 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0e0b0fe3-5fb9-4d51-a01e-44a0d036ddbb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:58.673456 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0e0b0fe3-5fb9-4d51-a01e-44a0d036ddbb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:58.673456 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0e0b0fe3-5fb9-4d51-a01e-44a0d036ddbb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:58.868952 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-079ecefd-785f-4019-9f3c-a17b9fcbc744 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:58.872883 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-0e0b0fe3-5fb9-4d51-a01e-44a0d036ddbb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:58.876992 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-079ecefd-785f-4019-9f3c-a17b9fcbc744 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:58.878665 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-079ecefd-785f-4019-9f3c-a17b9fcbc744 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:58.879768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-079ecefd-785f-4019-9f3c-a17b9fcbc744 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1406 microversion: 2.20 time: 0.249927 Jun 03 09:58:58.880260 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-0e0b0fe3-5fb9-4d51-a01e-44a0d036ddbb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1364 microversion: 2.1 time: 0.226000 Jun 03 09:58:58.880350 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 65/123] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 09:58:58 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:58:58.880821 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 59/124] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:58 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:59.626090 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-ea7b5d1b-0798-4926-9984-9328f337657e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:59.626733 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-ea7b5d1b-0798-4926-9984-9328f337657e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:59.633354 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ea7b5d1b-0798-4926-9984-9328f337657e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:59.633813 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ea7b5d1b-0798-4926-9984-9328f337657e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:59.634611 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ea7b5d1b-0798-4926-9984-9328f337657e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:59.635049 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ea7b5d1b-0798-4926-9984-9328f337657e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:59.794351 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-ea7b5d1b-0798-4926-9984-9328f337657e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:59.805847 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-ea7b5d1b-0798-4926-9984-9328f337657e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1321 microversion: 2.1 time: 0.183626 Jun 03 09:58:59.806577 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 66/125] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:59 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:58:59.896872 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-ad0c30d5-5a47-4f25-8ba4-6380ede2b222 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:59.897533 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-ad0c30d5-5a47-4f25-8ba4-6380ede2b222 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:59.897957 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-dbe7ef7e-ecdc-4435-9b5b-beb981c045ef tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:59.898811 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-dbe7ef7e-ecdc-4435-9b5b-beb981c045ef tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:59.904220 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ad0c30d5-5a47-4f25-8ba4-6380ede2b222 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:59.904671 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ad0c30d5-5a47-4f25-8ba4-6380ede2b222 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:59.905602 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ad0c30d5-5a47-4f25-8ba4-6380ede2b222 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:59.905907 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-dbe7ef7e-ecdc-4435-9b5b-beb981c045ef tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:59.906066 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ad0c30d5-5a47-4f25-8ba4-6380ede2b222 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:59.906389 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-dbe7ef7e-ecdc-4435-9b5b-beb981c045ef tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:59.907153 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-dbe7ef7e-ecdc-4435-9b5b-beb981c045ef tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:59.907591 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-dbe7ef7e-ecdc-4435-9b5b-beb981c045ef tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:00.112745 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-ad0c30d5-5a47-4f25-8ba4-6380ede2b222 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:00.119783 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-dbe7ef7e-ecdc-4435-9b5b-beb981c045ef tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:00.120816 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-ad0c30d5-5a47-4f25-8ba4-6380ede2b222 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1364 microversion: 2.1 time: 0.227926 Jun 03 09:59:00.121404 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 60/126] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:59 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:00.127908 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-dbe7ef7e-ecdc-4435-9b5b-beb981c045ef tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:00.129403 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-dbe7ef7e-ecdc-4435-9b5b-beb981c045ef tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:00.130528 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-dbe7ef7e-ecdc-4435-9b5b-beb981c045ef tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1406 microversion: 2.20 time: 0.236698 Jun 03 09:59:00.131071 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 67/127] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 09:58:59 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:59:00.823770 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-e91a5091-9d96-4719-87ae-bf26c8fbc79f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:00.824388 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-e91a5091-9d96-4719-87ae-bf26c8fbc79f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:00.830761 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e91a5091-9d96-4719-87ae-bf26c8fbc79f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:00.831219 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e91a5091-9d96-4719-87ae-bf26c8fbc79f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:00.831978 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e91a5091-9d96-4719-87ae-bf26c8fbc79f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:00.832417 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e91a5091-9d96-4719-87ae-bf26c8fbc79f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:00.971717 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-e91a5091-9d96-4719-87ae-bf26c8fbc79f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:00.985007 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-e91a5091-9d96-4719-87ae-bf26c8fbc79f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1321 microversion: 2.1 time: 0.165570 Jun 03 09:59:00.986004 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 61/128] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:00 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:01.138011 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-e96c8ff8-dac7-45ea-94d0-352c1d8a419d tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:01.138631 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-e96c8ff8-dac7-45ea-94d0-352c1d8a419d tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:01.144661 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e96c8ff8-dac7-45ea-94d0-352c1d8a419d tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:01.145110 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e96c8ff8-dac7-45ea-94d0-352c1d8a419d tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:01.145871 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e96c8ff8-dac7-45ea-94d0-352c1d8a419d tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:01.146339 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e96c8ff8-dac7-45ea-94d0-352c1d8a419d tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:01.148643 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-751d4cd4-d217-4613-85e1-40c9ad0908d5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:01.149260 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-751d4cd4-d217-4613-85e1-40c9ad0908d5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:01.155867 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-751d4cd4-d217-4613-85e1-40c9ad0908d5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:01.156316 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-751d4cd4-d217-4613-85e1-40c9ad0908d5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:01.157082 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-751d4cd4-d217-4613-85e1-40c9ad0908d5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:01.157522 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-751d4cd4-d217-4613-85e1-40c9ad0908d5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:01.361707 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-e96c8ff8-dac7-45ea-94d0-352c1d8a419d tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:01.366760 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-751d4cd4-d217-4613-85e1-40c9ad0908d5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:01.371060 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-e96c8ff8-dac7-45ea-94d0-352c1d8a419d tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1364 microversion: 2.1 time: 0.237094 Jun 03 09:59:01.371712 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 68/129] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:01 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1364 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:01.376601 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-751d4cd4-d217-4613-85e1-40c9ad0908d5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:01.378132 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-751d4cd4-d217-4613-85e1-40c9ad0908d5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:01.379232 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-751d4cd4-d217-4613-85e1-40c9ad0908d5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1406 microversion: 2.20 time: 0.234542 Jun 03 09:59:01.379771 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 62/130] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 09:59:01 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:59:01.484578 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-fe81d49e-54e5-46b1-aab4-5e12d0d2fe85 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5eaa1155-6a62-4ef2-920e-bcb0610be905"}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:59:01.484578 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-fe81d49e-54e5-46b1-aab4-5e12d0d2fe85 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:01.498969 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-fe81d49e-54e5-46b1-aab4-5e12d0d2fe85 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:01.499392 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-fe81d49e-54e5-46b1-aab4-5e12d0d2fe85 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:01.500398 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-fe81d49e-54e5-46b1-aab4-5e12d0d2fe85 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:01.501927 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-fe81d49e-54e5-46b1-aab4-5e12d0d2fe85 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:01.945078 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-76956271-48c7-4c4e-b9c7-a11f9bb12e0b req-ba8b0b8c-7b08-410f-bf23-00112bf36bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d7bf3d-d6e9-4a78-bf74-77b44928b1d3", "name": "network-vif-plugged", "status": "completed", "tag": "5e8649fd-c65a-45e0-87b5-6023ff2fceaf"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:59:01.956309 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-76956271-48c7-4c4e-b9c7-a11f9bb12e0b req-ba8b0b8c-7b08-410f-bf23-00112bf36bf0 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:01.957113 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-76956271-48c7-4c4e-b9c7-a11f9bb12e0b req-ba8b0b8c-7b08-410f-bf23-00112bf36bf0 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:01.972065 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-76956271-48c7-4c4e-b9c7-a11f9bb12e0b req-ba8b0b8c-7b08-410f-bf23-00112bf36bf0 service nova] Creating event network-vif-plugged:5e8649fd-c65a-45e0-87b5-6023ff2fceaf for instance 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 on hv-cinder-84456 Jun 03 09:59:01.976990 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-76956271-48c7-4c4e-b9c7-a11f9bb12e0b req-ba8b0b8c-7b08-410f-bf23-00112bf36bf0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041717 Jun 03 09:59:01.977580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 63/131] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 09:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:59:02.002281 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-0a6398f0-ddc3-4153-9aa8-279c742b7b17 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:02.002972 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-0a6398f0-ddc3-4153-9aa8-279c742b7b17 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:02.009160 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0a6398f0-ddc3-4153-9aa8-279c742b7b17 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:02.009609 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0a6398f0-ddc3-4153-9aa8-279c742b7b17 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:02.011032 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0a6398f0-ddc3-4153-9aa8-279c742b7b17 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:02.011473 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0a6398f0-ddc3-4153-9aa8-279c742b7b17 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:02.015671 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:SELECT=100 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:02.183462 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-0a6398f0-ddc3-4153-9aa8-279c742b7b17 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:02.191727 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-0a6398f0-ddc3-4153-9aa8-279c742b7b17 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1321 microversion: 2.1 time: 0.193468 Jun 03 09:59:02.192327 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 64/132] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:01 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:02.387766 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-d9cd78af-3e51-4028-8c89-acd3343cd396 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:02.388297 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-d9cd78af-3e51-4028-8c89-acd3343cd396 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:02.394792 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d9cd78af-3e51-4028-8c89-acd3343cd396 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:02.395377 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d9cd78af-3e51-4028-8c89-acd3343cd396 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:02.396155 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d9cd78af-3e51-4028-8c89-acd3343cd396 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:02.396645 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d9cd78af-3e51-4028-8c89-acd3343cd396 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:02.577938 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-d9cd78af-3e51-4028-8c89-acd3343cd396 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:02.585833 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-d9cd78af-3e51-4028-8c89-acd3343cd396 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1364 microversion: 2.1 time: 0.202240 Jun 03 09:59:02.586440 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 65/133] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:02 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:02.592046 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-b7336492-1c81-4a63-89bd-a08e865ac344 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:02.592653 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-b7336492-1c81-4a63-89bd-a08e865ac344 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:02.601062 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b7336492-1c81-4a63-89bd-a08e865ac344 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:02.601517 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b7336492-1c81-4a63-89bd-a08e865ac344 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:02.602475 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b7336492-1c81-4a63-89bd-a08e865ac344 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:02.602910 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b7336492-1c81-4a63-89bd-a08e865ac344 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:02.773426 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-b7336492-1c81-4a63-89bd-a08e865ac344 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:02.781991 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-b7336492-1c81-4a63-89bd-a08e865ac344 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:02.783563 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-b7336492-1c81-4a63-89bd-a08e865ac344 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:02.784670 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-b7336492-1c81-4a63-89bd-a08e865ac344 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1406 microversion: 2.20 time: 0.197036 Jun 03 09:59:02.785235 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 66/134] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 09:59:02 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:59:02.806696 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-fe81d49e-54e5-46b1-aab4-5e12d0d2fe85 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "POST /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.338789 Jun 03 09:59:02.813210 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 69/135] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jun 3 09:59:01 2022] POST /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a/os-volume_attachments => generated 194 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:59:03.208472 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-0ee57a8f-2ca5-4b6c-8a09-01de53c96aaf tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:03.209154 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-0ee57a8f-2ca5-4b6c-8a09-01de53c96aaf tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:03.215578 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0ee57a8f-2ca5-4b6c-8a09-01de53c96aaf tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:03.216027 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0ee57a8f-2ca5-4b6c-8a09-01de53c96aaf tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:03.216780 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0ee57a8f-2ca5-4b6c-8a09-01de53c96aaf tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:03.217215 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0ee57a8f-2ca5-4b6c-8a09-01de53c96aaf tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:03.389725 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-0ee57a8f-2ca5-4b6c-8a09-01de53c96aaf tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:03.398671 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-0ee57a8f-2ca5-4b6c-8a09-01de53c96aaf tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1321 microversion: 2.1 time: 0.193984 Jun 03 09:59:03.400664 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 67/136] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:03 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:03.603495 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-7552fe1a-f095-468c-89a1-ccf689fde037 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:03.604213 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-7552fe1a-f095-468c-89a1-ccf689fde037 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:03.614394 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7552fe1a-f095-468c-89a1-ccf689fde037 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:03.614852 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7552fe1a-f095-468c-89a1-ccf689fde037 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:03.615861 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7552fe1a-f095-468c-89a1-ccf689fde037 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:03.616302 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7552fe1a-f095-468c-89a1-ccf689fde037 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:03.804343 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-c7101ce1-6dda-45bd-b6e8-5662d9fb5f3c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:03.805104 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-c7101ce1-6dda-45bd-b6e8-5662d9fb5f3c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:03.816671 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c7101ce1-6dda-45bd-b6e8-5662d9fb5f3c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:03.818692 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c7101ce1-6dda-45bd-b6e8-5662d9fb5f3c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:03.819512 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c7101ce1-6dda-45bd-b6e8-5662d9fb5f3c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:03.821483 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c7101ce1-6dda-45bd-b6e8-5662d9fb5f3c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:03.948880 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-7552fe1a-f095-468c-89a1-ccf689fde037 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:03.962233 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-7552fe1a-f095-468c-89a1-ccf689fde037 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1364 microversion: 2.1 time: 0.363344 Jun 03 09:59:03.963069 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 70/137] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:03 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1364 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:04.061449 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-c7101ce1-6dda-45bd-b6e8-5662d9fb5f3c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:04.078888 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-c7101ce1-6dda-45bd-b6e8-5662d9fb5f3c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:04.078888 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-c7101ce1-6dda-45bd-b6e8-5662d9fb5f3c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:04.081256 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-c7101ce1-6dda-45bd-b6e8-5662d9fb5f3c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1406 microversion: 2.20 time: 0.282151 Jun 03 09:59:04.082573 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 68/138] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 09:59:03 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1406 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:59:04.420450 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-207f7dd2-027c-4573-a5ea-3c0e26fcd4f8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:04.421097 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-207f7dd2-027c-4573-a5ea-3c0e26fcd4f8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:04.427308 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-207f7dd2-027c-4573-a5ea-3c0e26fcd4f8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:04.427764 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-207f7dd2-027c-4573-a5ea-3c0e26fcd4f8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:04.428556 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-207f7dd2-027c-4573-a5ea-3c0e26fcd4f8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:04.428997 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-207f7dd2-027c-4573-a5ea-3c0e26fcd4f8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:04.562979 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-207f7dd2-027c-4573-a5ea-3c0e26fcd4f8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:04.569342 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-207f7dd2-027c-4573-a5ea-3c0e26fcd4f8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1321 microversion: 2.1 time: 0.153340 Jun 03 09:59:04.569922 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 71/139] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:04 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:04.982297 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-7898c1f3-9890-4cdb-8b7d-4722edf9d915 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:04.982297 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-7898c1f3-9890-4cdb-8b7d-4722edf9d915 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:04.988465 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7898c1f3-9890-4cdb-8b7d-4722edf9d915 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:04.988918 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7898c1f3-9890-4cdb-8b7d-4722edf9d915 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:04.989682 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7898c1f3-9890-4cdb-8b7d-4722edf9d915 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:04.990141 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7898c1f3-9890-4cdb-8b7d-4722edf9d915 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:05.100476 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-934fc67e-aa96-47ed-84d0-c86eba41aa1a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:05.102807 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-934fc67e-aa96-47ed-84d0-c86eba41aa1a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:05.111451 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-934fc67e-aa96-47ed-84d0-c86eba41aa1a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:05.112086 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-934fc67e-aa96-47ed-84d0-c86eba41aa1a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:05.112948 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-934fc67e-aa96-47ed-84d0-c86eba41aa1a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:05.113429 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-934fc67e-aa96-47ed-84d0-c86eba41aa1a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:05.156079 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-7898c1f3-9890-4cdb-8b7d-4722edf9d915 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:05.167609 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-7898c1f3-9890-4cdb-8b7d-4722edf9d915 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1364 microversion: 2.1 time: 0.189631 Jun 03 09:59:05.168034 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 69/140] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:04 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1364 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:05.347108 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-934fc67e-aa96-47ed-84d0-c86eba41aa1a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:05.356530 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-934fc67e-aa96-47ed-84d0-c86eba41aa1a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:05.358350 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-934fc67e-aa96-47ed-84d0-c86eba41aa1a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:05.359605 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-934fc67e-aa96-47ed-84d0-c86eba41aa1a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1406 microversion: 2.20 time: 0.264347 Jun 03 09:59:05.360304 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 72/141] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 09:59:05 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1406 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:59:05.585756 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-1833bbab-a735-4dfd-88fd-628c3cd8e633 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:05.586784 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-1833bbab-a735-4dfd-88fd-628c3cd8e633 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:05.593277 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1833bbab-a735-4dfd-88fd-628c3cd8e633 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:05.593729 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1833bbab-a735-4dfd-88fd-628c3cd8e633 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:05.594531 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1833bbab-a735-4dfd-88fd-628c3cd8e633 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:05.595064 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1833bbab-a735-4dfd-88fd-628c3cd8e633 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:05.754824 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-1833bbab-a735-4dfd-88fd-628c3cd8e633 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:05.762712 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-1833bbab-a735-4dfd-88fd-628c3cd8e633 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1513 microversion: 2.1 time: 0.180517 Jun 03 09:59:05.763294 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 70/142] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:05 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1513 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:05.779896 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-38516972-30eb-46bf-8655-c2c125d85fe7 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:59:05.780876 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-38516972-30eb-46bf-8655-c2c125d85fe7 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:05.786806 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-38516972-30eb-46bf-8655-c2c125d85fe7 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:05.787249 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-38516972-30eb-46bf-8655-c2c125d85fe7 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:05.789488 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-38516972-30eb-46bf-8655-c2c125d85fe7 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:05.789488 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-38516972-30eb-46bf-8655-c2c125d85fe7 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:05.959531 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.objects.instance [None req-38516972-30eb-46bf-8655-c2c125d85fe7 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lazy-loading 'flavor' on Instance uuid 268a2ebf-7c18-40e4-85fb-edf05a174e1d {{(pid=125065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:59:05.977776 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-bd848ea7-85d9-40a1-af4f-380bc628afc0 req-684e4e5a-2255-4e5f-94d6-68598bac0535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6517823d-711a-4e24-9cdf-27812d522a46", "name": "network-vif-plugged", "status": "completed", "tag": "a93886de-f812-40e6-81ba-b35e06454a66"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:59:05.988963 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-bd848ea7-85d9-40a1-af4f-380bc628afc0 req-684e4e5a-2255-4e5f-94d6-68598bac0535 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:05.989548 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-bd848ea7-85d9-40a1-af4f-380bc628afc0 req-684e4e5a-2255-4e5f-94d6-68598bac0535 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:06.008581 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-bd848ea7-85d9-40a1-af4f-380bc628afc0 req-684e4e5a-2255-4e5f-94d6-68598bac0535 service nova] Creating event network-vif-plugged:a93886de-f812-40e6-81ba-b35e06454a66 for instance 6517823d-711a-4e24-9cdf-27812d522a46 on hv-cinder-84456 Jun 03 09:59:06.014711 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-bd848ea7-85d9-40a1-af4f-380bc628afc0 req-684e4e5a-2255-4e5f-94d6-68598bac0535 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041007 Jun 03 09:59:06.015845 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 71/143] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 09:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:59:06.189426 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-0a6fbd22-05b7-43d4-914e-730bac8aa5d8 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:06.194151 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-0a6fbd22-05b7-43d4-914e-730bac8aa5d8 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:06.197407 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0a6fbd22-05b7-43d4-914e-730bac8aa5d8 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:06.198709 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0a6fbd22-05b7-43d4-914e-730bac8aa5d8 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:06.199533 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0a6fbd22-05b7-43d4-914e-730bac8aa5d8 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:06.199994 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0a6fbd22-05b7-43d4-914e-730bac8aa5d8 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:06.377806 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-0a6fbd22-05b7-43d4-914e-730bac8aa5d8 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:06.399837 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-0a6fbd22-05b7-43d4-914e-730bac8aa5d8 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1364 microversion: 2.1 time: 0.217743 Jun 03 09:59:06.400527 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 72/144] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:06 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1364 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:06.406445 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-f0b1a3c9-efab-48f0-b3c5-03a6f1d7820b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:06.407161 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-f0b1a3c9-efab-48f0-b3c5-03a6f1d7820b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:06.413286 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f0b1a3c9-efab-48f0-b3c5-03a6f1d7820b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:06.413839 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f0b1a3c9-efab-48f0-b3c5-03a6f1d7820b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:06.414701 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f0b1a3c9-efab-48f0-b3c5-03a6f1d7820b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:06.415199 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f0b1a3c9-efab-48f0-b3c5-03a6f1d7820b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:06.503080 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-38516972-30eb-46bf-8655-c2c125d85fe7 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "POST /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d/action" status: 200 len: 32 microversion: 2.1 time: 0.727076 Jun 03 09:59:06.503782 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 73/145] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jun 3 09:59:05 2022] POST /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d/action => generated 32 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 09:59:06.535676 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-5b03e6e9-99d5-4e4f-a228-38d13a1ceed2 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:06.536363 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-5b03e6e9-99d5-4e4f-a228-38d13a1ceed2 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:06.562375 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5b03e6e9-99d5-4e4f-a228-38d13a1ceed2 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:06.562375 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5b03e6e9-99d5-4e4f-a228-38d13a1ceed2 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:06.562375 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5b03e6e9-99d5-4e4f-a228-38d13a1ceed2 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:06.562375 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5b03e6e9-99d5-4e4f-a228-38d13a1ceed2 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:06.722045 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-f0b1a3c9-efab-48f0-b3c5-03a6f1d7820b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:06.729518 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-f0b1a3c9-efab-48f0-b3c5-03a6f1d7820b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:06.731068 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-f0b1a3c9-efab-48f0-b3c5-03a6f1d7820b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:06.732198 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-f0b1a3c9-efab-48f0-b3c5-03a6f1d7820b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1406 microversion: 2.20 time: 0.329994 Jun 03 09:59:06.732769 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 73/146] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 09:59:06 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1406 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:59:06.808943 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-5b03e6e9-99d5-4e4f-a228-38d13a1ceed2 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:06.816521 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-5b03e6e9-99d5-4e4f-a228-38d13a1ceed2 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.285201 Jun 03 09:59:06.817088 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 74/147] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:06 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:07.416706 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-d21ba18d-0fd4-47c1-ad97-385e73799b2e tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:07.417469 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-d21ba18d-0fd4-47c1-ad97-385e73799b2e tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:07.423486 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d21ba18d-0fd4-47c1-ad97-385e73799b2e tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:07.423925 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d21ba18d-0fd4-47c1-ad97-385e73799b2e tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:07.424692 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d21ba18d-0fd4-47c1-ad97-385e73799b2e tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:07.425209 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d21ba18d-0fd4-47c1-ad97-385e73799b2e tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:07.594619 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-d21ba18d-0fd4-47c1-ad97-385e73799b2e tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:07.602104 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-d21ba18d-0fd4-47c1-ad97-385e73799b2e tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1551 microversion: 2.1 time: 0.189412 Jun 03 09:59:07.602730 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 74/148] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:07 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1551 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:07.620237 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-a4435ac9-f215-4047-acfd-77b2902c6d09 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:07.620772 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-a4435ac9-f215-4047-acfd-77b2902c6d09 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:07.627189 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a4435ac9-f215-4047-acfd-77b2902c6d09 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:07.627816 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a4435ac9-f215-4047-acfd-77b2902c6d09 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:07.629061 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a4435ac9-f215-4047-acfd-77b2902c6d09 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:07.629649 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a4435ac9-f215-4047-acfd-77b2902c6d09 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:07.751449 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-a7976c91-dea5-4328-b758-b71633ef205d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:07.752644 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-a7976c91-dea5-4328-b758-b71633ef205d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:07.761971 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-a4435ac9-f215-4047-acfd-77b2902c6d09 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.146361 Jun 03 09:59:07.762838 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 75/149] 10.222.0.42 () {58 vars in 1274 bytes} [Fri Jun 3 09:59:07 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3/os-interface => generated 285 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:59:07.770808 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a7976c91-dea5-4328-b758-b71633ef205d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:07.776969 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a7976c91-dea5-4328-b758-b71633ef205d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:07.776969 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a7976c91-dea5-4328-b758-b71633ef205d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:07.776969 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a7976c91-dea5-4328-b758-b71633ef205d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:07.833016 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-bb520100-8b65-4983-8935-d06c1c0fad61 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:07.833868 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-bb520100-8b65-4983-8935-d06c1c0fad61 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:07.841692 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-bb520100-8b65-4983-8935-d06c1c0fad61 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:07.842203 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-bb520100-8b65-4983-8935-d06c1c0fad61 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:07.842999 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-bb520100-8b65-4983-8935-d06c1c0fad61 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:07.843438 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-bb520100-8b65-4983-8935-d06c1c0fad61 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:08.379363 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-a7976c91-dea5-4328-b758-b71633ef205d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:08.382506 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-bb520100-8b65-4983-8935-d06c1c0fad61 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:08.396220 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-a7976c91-dea5-4328-b758-b71633ef205d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:08.401622 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-a7976c91-dea5-4328-b758-b71633ef205d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:08.403151 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-bb520100-8b65-4983-8935-d06c1c0fad61 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.562626 Jun 03 09:59:08.406007 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-a7976c91-dea5-4328-b758-b71633ef205d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1406 microversion: 2.20 time: 0.658874 Jun 03 09:59:08.406809 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 75/150] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 09:59:07 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1406 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:59:08.407899 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 76/151] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:07 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:09.423828 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-8e3437f2-ef22-4dc9-8ed9-65bd59290b26 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:09.424777 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-5aec2faa-ec9e-4aff-8d9b-c8cf3fb77851 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:09.425413 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-5aec2faa-ec9e-4aff-8d9b-c8cf3fb77851 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:09.425899 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-8e3437f2-ef22-4dc9-8ed9-65bd59290b26 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:09.433063 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8e3437f2-ef22-4dc9-8ed9-65bd59290b26 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:09.433852 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8e3437f2-ef22-4dc9-8ed9-65bd59290b26 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:09.434071 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5aec2faa-ec9e-4aff-8d9b-c8cf3fb77851 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:09.435092 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8e3437f2-ef22-4dc9-8ed9-65bd59290b26 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:09.435731 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8e3437f2-ef22-4dc9-8ed9-65bd59290b26 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:09.436225 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5aec2faa-ec9e-4aff-8d9b-c8cf3fb77851 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:09.437020 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5aec2faa-ec9e-4aff-8d9b-c8cf3fb77851 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:09.437461 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5aec2faa-ec9e-4aff-8d9b-c8cf3fb77851 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:09.788223 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-8e3437f2-ef22-4dc9-8ed9-65bd59290b26 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:09.796963 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-8e3437f2-ef22-4dc9-8ed9-65bd59290b26 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:09.798631 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-8e3437f2-ef22-4dc9-8ed9-65bd59290b26 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:09.799788 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-8e3437f2-ef22-4dc9-8ed9-65bd59290b26 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1599 microversion: 2.20 time: 0.379826 Jun 03 09:59:09.800346 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 76/152] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 09:59:09 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1599 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:59:09.803921 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-5aec2faa-ec9e-4aff-8d9b-c8cf3fb77851 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:09.813810 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-5aec2faa-ec9e-4aff-8d9b-c8cf3fb77851 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.393536 Jun 03 09:59:09.814618 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 77/153] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:09 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:09.822412 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-d34b0c8e-b57f-4365-ab03-cef292c44a6a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:09.823698 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-d34b0c8e-b57f-4365-ab03-cef292c44a6a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:09.830487 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d34b0c8e-b57f-4365-ab03-cef292c44a6a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:09.831115 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d34b0c8e-b57f-4365-ab03-cef292c44a6a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:09.832063 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d34b0c8e-b57f-4365-ab03-cef292c44a6a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:09.832696 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d34b0c8e-b57f-4365-ab03-cef292c44a6a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:10.072538 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-d34b0c8e-b57f-4365-ab03-cef292c44a6a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.253825 Jun 03 09:59:10.073797 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 77/154] 10.222.0.42 () {60 vars in 1315 bytes} [Fri Jun 3 09:59:09 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46/os-interface => generated 285 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:59:10.103657 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-6e2a28d3-5e6f-4985-9143-a80c39924ce8 req-6ef46759-3a29-4496-b4cf-71b28695e40b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22d7bf3d-d6e9-4a78-bf74-77b44928b1d3", "tag": "5e8649fd-c65a-45e0-87b5-6023ff2fceaf"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:59:10.114685 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-6e2a28d3-5e6f-4985-9143-a80c39924ce8 req-6ef46759-3a29-4496-b4cf-71b28695e40b service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:10.115127 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-6e2a28d3-5e6f-4985-9143-a80c39924ce8 req-6ef46759-3a29-4496-b4cf-71b28695e40b service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:10.128156 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-6e2a28d3-5e6f-4985-9143-a80c39924ce8 req-6ef46759-3a29-4496-b4cf-71b28695e40b service nova] Creating event network-changed:5e8649fd-c65a-45e0-87b5-6023ff2fceaf for instance 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 on hv-cinder-84456 Jun 03 09:59:10.133582 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-6e2a28d3-5e6f-4985-9143-a80c39924ce8 req-6ef46759-3a29-4496-b4cf-71b28695e40b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033715 Jun 03 09:59:10.134902 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 78/155] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 09:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:59:10.831496 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-292a7d8b-31e4-4396-ad49-1a79d91fd6cb tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:10.832370 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-292a7d8b-31e4-4396-ad49-1a79d91fd6cb tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:10.840730 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_api:SELECT=100 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:10.842063 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-292a7d8b-31e4-4396-ad49-1a79d91fd6cb tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:10.842438 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-292a7d8b-31e4-4396-ad49-1a79d91fd6cb tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:10.843253 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-292a7d8b-31e4-4396-ad49-1a79d91fd6cb tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:10.845631 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-292a7d8b-31e4-4396-ad49-1a79d91fd6cb tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:11.086143 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-292a7d8b-31e4-4396-ad49-1a79d91fd6cb tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:11.100098 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-292a7d8b-31e4-4396-ad49-1a79d91fd6cb tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.272483 Jun 03 09:59:11.100703 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 78/156] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:10 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:11.958455 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-ce94d37e-9673-40bd-bccf-157ea5997736 req-10d4abed-eec2-49ff-a2a9-2560f99b15ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6517823d-711a-4e24-9cdf-27812d522a46", "tag": "a93886de-f812-40e6-81ba-b35e06454a66"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:59:11.967888 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-ce94d37e-9673-40bd-bccf-157ea5997736 req-10d4abed-eec2-49ff-a2a9-2560f99b15ce service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:11.968337 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-ce94d37e-9673-40bd-bccf-157ea5997736 req-10d4abed-eec2-49ff-a2a9-2560f99b15ce service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:11.972839 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:11.981328 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-ce94d37e-9673-40bd-bccf-157ea5997736 req-10d4abed-eec2-49ff-a2a9-2560f99b15ce service nova] Creating event network-changed:a93886de-f812-40e6-81ba-b35e06454a66 for instance 6517823d-711a-4e24-9cdf-27812d522a46 on hv-cinder-84456 Jun 03 09:59:11.987120 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-ce94d37e-9673-40bd-bccf-157ea5997736 req-10d4abed-eec2-49ff-a2a9-2560f99b15ce service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177116 Jun 03 09:59:11.987798 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 79/157] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 09:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:59:12.120767 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-05e8ee90-f0be-4df3-9ad0-0ed6fa1a4744 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:12.121309 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-05e8ee90-f0be-4df3-9ad0-0ed6fa1a4744 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:12.135598 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-05e8ee90-f0be-4df3-9ad0-0ed6fa1a4744 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:12.136431 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-05e8ee90-f0be-4df3-9ad0-0ed6fa1a4744 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:12.137709 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-05e8ee90-f0be-4df3-9ad0-0ed6fa1a4744 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:12.138361 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-05e8ee90-f0be-4df3-9ad0-0ed6fa1a4744 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:12.308673 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-05e8ee90-f0be-4df3-9ad0-0ed6fa1a4744 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:12.328283 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-05e8ee90-f0be-4df3-9ad0-0ed6fa1a4744 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.211804 Jun 03 09:59:12.329248 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 79/158] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:12 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:13.355720 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-c970a391-1f58-414e-9a23-3fafa33b0a40 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:13.356413 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-c970a391-1f58-414e-9a23-3fafa33b0a40 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:13.363208 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c970a391-1f58-414e-9a23-3fafa33b0a40 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:13.363652 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c970a391-1f58-414e-9a23-3fafa33b0a40 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:13.364404 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c970a391-1f58-414e-9a23-3fafa33b0a40 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:13.364830 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c970a391-1f58-414e-9a23-3fafa33b0a40 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:13.497595 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-c970a391-1f58-414e-9a23-3fafa33b0a40 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:13.503291 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-c970a391-1f58-414e-9a23-3fafa33b0a40 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.152637 Jun 03 09:59:13.503861 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 80/159] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:13 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:14.531719 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-e6d8cb03-2db2-4b9b-af50-029d37d17a94 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:14.531719 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-e6d8cb03-2db2-4b9b-af50-029d37d17a94 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:14.531719 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e6d8cb03-2db2-4b9b-af50-029d37d17a94 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:14.531719 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e6d8cb03-2db2-4b9b-af50-029d37d17a94 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:14.532353 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e6d8cb03-2db2-4b9b-af50-029d37d17a94 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:14.532353 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e6d8cb03-2db2-4b9b-af50-029d37d17a94 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:14.654865 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-e6d8cb03-2db2-4b9b-af50-029d37d17a94 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:14.662424 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-e6d8cb03-2db2-4b9b-af50-029d37d17a94 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.145692 Jun 03 09:59:14.662996 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 80/160] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:14 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:15.682271 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-abe59f04-e81a-4093-b0d1-208961f9681b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:15.682271 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-abe59f04-e81a-4093-b0d1-208961f9681b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:15.683390 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_api:SELECT=94 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:15.688503 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-abe59f04-e81a-4093-b0d1-208961f9681b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:15.688954 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-abe59f04-e81a-4093-b0d1-208961f9681b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:15.689745 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-abe59f04-e81a-4093-b0d1-208961f9681b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:15.690212 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-abe59f04-e81a-4093-b0d1-208961f9681b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:15.826443 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-abe59f04-e81a-4093-b0d1-208961f9681b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:15.833962 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-abe59f04-e81a-4093-b0d1-208961f9681b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.158312 Jun 03 09:59:15.834530 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 81/161] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:15 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:16.850924 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-d416a0c8-4902-4bef-a54d-0891d17d4edb tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:16.851531 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-d416a0c8-4902-4bef-a54d-0891d17d4edb tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:16.857585 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d416a0c8-4902-4bef-a54d-0891d17d4edb tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:16.858068 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d416a0c8-4902-4bef-a54d-0891d17d4edb tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:16.858825 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d416a0c8-4902-4bef-a54d-0891d17d4edb tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:16.859259 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d416a0c8-4902-4bef-a54d-0891d17d4edb tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:16.991314 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-d416a0c8-4902-4bef-a54d-0891d17d4edb tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:16.993473 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:SELECT=100 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:16.999926 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-d416a0c8-4902-4bef-a54d-0891d17d4edb tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.152779 Jun 03 09:59:17.000492 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 81/162] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:16 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:17.680584 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-c89f8bda-95b8-4b5f-9960-3cb3cf87b915 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:17.681319 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-c89f8bda-95b8-4b5f-9960-3cb3cf87b915 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:17.689399 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c89f8bda-95b8-4b5f-9960-3cb3cf87b915 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:17.689851 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c89f8bda-95b8-4b5f-9960-3cb3cf87b915 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:17.690643 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c89f8bda-95b8-4b5f-9960-3cb3cf87b915 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:17.691081 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c89f8bda-95b8-4b5f-9960-3cb3cf87b915 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:17.734221 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-c89f8bda-95b8-4b5f-9960-3cb3cf87b915 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Going to try to terminate instance {{(pid=125065) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 09:59:18.020588 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-c914d366-c852-4fa8-8e80-fa142f28c0de tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:18.022013 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-c914d366-c852-4fa8-8e80-fa142f28c0de tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:18.029433 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c914d366-c852-4fa8-8e80-fa142f28c0de tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:18.030109 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c914d366-c852-4fa8-8e80-fa142f28c0de tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:18.031060 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c914d366-c852-4fa8-8e80-fa142f28c0de tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:18.031834 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c914d366-c852-4fa8-8e80-fa142f28c0de tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:18.189712 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-c89f8bda-95b8-4b5f-9960-3cb3cf87b915 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 204 len: 0 microversion: 2.1 time: 0.512736 Jun 03 09:59:18.190512 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 82/163] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 3 09:59:17 2022] DELETE /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 0 bytes in 514 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 09:59:18.199669 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-a70dacf8-9b7d-40f6-9f0e-a62d91b8c9fd tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:18.200578 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-a70dacf8-9b7d-40f6-9f0e-a62d91b8c9fd tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:18.206622 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a70dacf8-9b7d-40f6-9f0e-a62d91b8c9fd tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:18.207067 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a70dacf8-9b7d-40f6-9f0e-a62d91b8c9fd tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:18.207994 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a70dacf8-9b7d-40f6-9f0e-a62d91b8c9fd tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:18.208637 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a70dacf8-9b7d-40f6-9f0e-a62d91b8c9fd tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:18.221613 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-c914d366-c852-4fa8-8e80-fa142f28c0de tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:18.229439 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-c914d366-c852-4fa8-8e80-fa142f28c0de tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.216001 Jun 03 09:59:18.230036 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 82/164] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:18 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:18.350350 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-a70dacf8-9b7d-40f6-9f0e-a62d91b8c9fd tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:18.361160 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-a70dacf8-9b7d-40f6-9f0e-a62d91b8c9fd tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1554 microversion: 2.1 time: 0.166405 Jun 03 09:59:18.361938 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 83/165] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:18 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:19.246507 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-ddfa7ebb-89ca-4be1-b7ad-0aa45231fe38 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:19.247230 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-ddfa7ebb-89ca-4be1-b7ad-0aa45231fe38 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:19.253486 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ddfa7ebb-89ca-4be1-b7ad-0aa45231fe38 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:19.255400 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ddfa7ebb-89ca-4be1-b7ad-0aa45231fe38 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:19.256516 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ddfa7ebb-89ca-4be1-b7ad-0aa45231fe38 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:19.256516 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ddfa7ebb-89ca-4be1-b7ad-0aa45231fe38 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:19.378595 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-1a92d193-a26d-4afd-83d6-760a3d68a658 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:19.379783 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-1a92d193-a26d-4afd-83d6-760a3d68a658 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:19.391706 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1a92d193-a26d-4afd-83d6-760a3d68a658 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:19.392320 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1a92d193-a26d-4afd-83d6-760a3d68a658 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:19.393223 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1a92d193-a26d-4afd-83d6-760a3d68a658 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:19.393787 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1a92d193-a26d-4afd-83d6-760a3d68a658 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:19.402975 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-ddfa7ebb-89ca-4be1-b7ad-0aa45231fe38 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:19.411743 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-ddfa7ebb-89ca-4be1-b7ad-0aa45231fe38 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.169124 Jun 03 09:59:19.412402 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 83/166] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:19 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:19.556193 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-1a92d193-a26d-4afd-83d6-760a3d68a658 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:19.564932 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-1a92d193-a26d-4afd-83d6-760a3d68a658 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1554 microversion: 2.1 time: 0.190363 Jun 03 09:59:19.565586 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 84/167] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:19 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1554 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:20.428582 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-9eb0583a-0e23-4c3a-9001-904655c0aaff tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:20.429733 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-9eb0583a-0e23-4c3a-9001-904655c0aaff tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:20.436028 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9eb0583a-0e23-4c3a-9001-904655c0aaff tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:20.436479 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9eb0583a-0e23-4c3a-9001-904655c0aaff tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:20.437236 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9eb0583a-0e23-4c3a-9001-904655c0aaff tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:20.437674 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9eb0583a-0e23-4c3a-9001-904655c0aaff tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:20.582250 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-67240b39-8c1c-499a-b150-d133951389e6 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:20.582978 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-67240b39-8c1c-499a-b150-d133951389e6 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:20.584670 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-9eb0583a-0e23-4c3a-9001-904655c0aaff tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:20.590749 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-67240b39-8c1c-499a-b150-d133951389e6 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:20.591280 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-67240b39-8c1c-499a-b150-d133951389e6 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:20.592121 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-67240b39-8c1c-499a-b150-d133951389e6 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:20.592682 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-67240b39-8c1c-499a-b150-d133951389e6 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:20.593228 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-9eb0583a-0e23-4c3a-9001-904655c0aaff tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.168528 Jun 03 09:59:20.593808 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 84/168] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:20 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:20.721565 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-67240b39-8c1c-499a-b150-d133951389e6 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:20.730103 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-67240b39-8c1c-499a-b150-d133951389e6 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1554 microversion: 2.1 time: 0.152359 Jun 03 09:59:20.730673 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 85/169] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:20 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:21.611596 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-2c92ebb8-11a6-4ae8-96c9-b4d281bf733a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:21.613029 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-2c92ebb8-11a6-4ae8-96c9-b4d281bf733a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:21.619246 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2c92ebb8-11a6-4ae8-96c9-b4d281bf733a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:21.619881 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2c92ebb8-11a6-4ae8-96c9-b4d281bf733a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:21.620810 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2c92ebb8-11a6-4ae8-96c9-b4d281bf733a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:21.621438 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2c92ebb8-11a6-4ae8-96c9-b4d281bf733a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:21.747575 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-475316f3-31a6-4414-b4d3-da4e80092680 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:21.749057 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-475316f3-31a6-4414-b4d3-da4e80092680 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:21.756481 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-475316f3-31a6-4414-b4d3-da4e80092680 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:21.757051 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-475316f3-31a6-4414-b4d3-da4e80092680 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:21.758109 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-475316f3-31a6-4414-b4d3-da4e80092680 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:21.762351 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-2c92ebb8-11a6-4ae8-96c9-b4d281bf733a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:21.762621 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-475316f3-31a6-4414-b4d3-da4e80092680 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:21.770398 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-2c92ebb8-11a6-4ae8-96c9-b4d281bf733a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.163410 Jun 03 09:59:21.771112 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 85/170] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:21 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:21.891582 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-475316f3-31a6-4414-b4d3-da4e80092680 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:21.899669 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-475316f3-31a6-4414-b4d3-da4e80092680 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1554 microversion: 2.1 time: 0.156343 Jun 03 09:59:21.900241 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 86/171] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:21 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:22.788228 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-e10e608a-a144-4210-a136-bb9f1918823f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:22.788842 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-e10e608a-a144-4210-a136-bb9f1918823f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:22.795201 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e10e608a-a144-4210-a136-bb9f1918823f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:22.795651 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e10e608a-a144-4210-a136-bb9f1918823f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:22.796412 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e10e608a-a144-4210-a136-bb9f1918823f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:22.796850 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e10e608a-a144-4210-a136-bb9f1918823f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:22.917616 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-774f8e5b-3202-4f11-8234-0734e68275c0 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:22.918326 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-774f8e5b-3202-4f11-8234-0734e68275c0 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:22.925604 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-774f8e5b-3202-4f11-8234-0734e68275c0 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:22.926719 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-774f8e5b-3202-4f11-8234-0734e68275c0 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:22.927561 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-774f8e5b-3202-4f11-8234-0734e68275c0 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:22.928064 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-774f8e5b-3202-4f11-8234-0734e68275c0 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:22.929221 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-e10e608a-a144-4210-a136-bb9f1918823f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:22.938522 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-e10e608a-a144-4210-a136-bb9f1918823f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.153874 Jun 03 09:59:22.939642 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 86/172] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:22 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:23.380171 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-774f8e5b-3202-4f11-8234-0734e68275c0 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:23.391112 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-774f8e5b-3202-4f11-8234-0734e68275c0 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1554 microversion: 2.1 time: 0.477398 Jun 03 09:59:23.402464 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 87/173] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:22 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1554 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:23.956535 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-349b626e-2c33-4f6a-991d-8a20b307362c tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:23.957361 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-349b626e-2c33-4f6a-991d-8a20b307362c tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:23.964143 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-349b626e-2c33-4f6a-991d-8a20b307362c tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:23.964738 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-349b626e-2c33-4f6a-991d-8a20b307362c tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:23.966212 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-349b626e-2c33-4f6a-991d-8a20b307362c tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:23.966655 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-349b626e-2c33-4f6a-991d-8a20b307362c tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:23.976033 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-edaa8901-8abf-4ff7-919f-54c2b99e42c7 req-68a2f33f-4f4c-4d14-b4b3-3b86775d0df4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fee24c1-4a54-47e9-9a0a-0726af3cf00a", "name": "network-vif-deleted", "tag": "7f22a49d-b6ec-4dd7-93b2-f7ec2f927c22"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:59:23.986929 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-edaa8901-8abf-4ff7-919f-54c2b99e42c7 req-68a2f33f-4f4c-4d14-b4b3-3b86775d0df4 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:23.987590 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-edaa8901-8abf-4ff7-919f-54c2b99e42c7 req-68a2f33f-4f4c-4d14-b4b3-3b86775d0df4 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:24.000512 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-edaa8901-8abf-4ff7-919f-54c2b99e42c7 req-68a2f33f-4f4c-4d14-b4b3-3b86775d0df4 service nova] Creating event network-vif-deleted:7f22a49d-b6ec-4dd7-93b2-f7ec2f927c22 for instance 0fee24c1-4a54-47e9-9a0a-0726af3cf00a on hv-cinder-84456 Jun 03 09:59:24.006155 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-edaa8901-8abf-4ff7-919f-54c2b99e42c7 req-68a2f33f-4f4c-4d14-b4b3-3b86775d0df4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034121 Jun 03 09:59:24.006774 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 88/174] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 09:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:59:24.124928 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-349b626e-2c33-4f6a-991d-8a20b307362c tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:24.134231 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-349b626e-2c33-4f6a-991d-8a20b307362c tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.182027 Jun 03 09:59:24.135374 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 87/175] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:23 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:24.402748 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-e7527660-6241-47fc-a1cb-e739748c461f tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1333031629", "imageRef": "0d2dd03b-4531-46f3-88da-0380e97b1bd4", "flavorRef": "452", "networks": [{"uuid": "98a7d991-7855-4bdc-8799-20026edb30df"}]}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:59:24.409799 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-5a5a1cc0-ffe8-4253-8c08-ad79ae9fedb8 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:24.410735 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-5a5a1cc0-ffe8-4253-8c08-ad79ae9fedb8 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:24.417182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5a5a1cc0-ffe8-4253-8c08-ad79ae9fedb8 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:24.418498 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5a5a1cc0-ffe8-4253-8c08-ad79ae9fedb8 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:24.419264 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5a5a1cc0-ffe8-4253-8c08-ad79ae9fedb8 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:24.419696 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5a5a1cc0-ffe8-4253-8c08-ad79ae9fedb8 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:24.460307 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.network.neutron [None req-e7527660-6241-47fc-a1cb-e739748c461f tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] validate_networks() for [('98a7d991-7855-4bdc-8799-20026edb30df', None, None, None, None, None)] {{(pid=125065) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:59:24.484725 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-5a5a1cc0-ffe8-4253-8c08-ad79ae9fedb8 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:24.492871 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-5a5a1cc0-ffe8-4253-8c08-ad79ae9fedb8 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1346 microversion: 2.1 time: 0.087650 Jun 03 09:59:24.493446 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 88/176] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:24 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:24.837052 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-e7527660-6241-47fc-a1cb-e739748c461f tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Flavor limits 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:59:24.837497 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-e7527660-6241-47fc-a1cb-e739748c461f tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Image limits 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:59:24.838028 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-e7527660-6241-47fc-a1cb-e739748c461f tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Flavor pref 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:59:24.838428 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-e7527660-6241-47fc-a1cb-e739748c461f tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Image pref 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:59:24.838836 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-e7527660-6241-47fc-a1cb-e739748c461f tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:59:24.847864 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e7527660-6241-47fc-a1cb-e739748c461f tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:24.848308 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e7527660-6241-47fc-a1cb-e739748c461f tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:24.849085 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e7527660-6241-47fc-a1cb-e739748c461f tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:24.849672 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e7527660-6241-47fc-a1cb-e739748c461f tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:24.866890 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.quota [None req-e7527660-6241-47fc-a1cb-e739748c461f tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Getting quotas for project 4e1793ba5f584cb0a9005c50d80c5c06. Resources: {'ram', 'instances', 'cores'} {{(pid=125065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:59:24.871476 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.quota [None req-e7527660-6241-47fc-a1cb-e739748c461f tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Getting quotas for user 3dd300436c9545faa56d60ac290bc987 and project 4e1793ba5f584cb0a9005c50d80c5c06. Resources: {'ram', 'instances', 'cores'} {{(pid=125065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:59:24.882274 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-e7527660-6241-47fc-a1cb-e739748c461f tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Going to run 1 instances... {{(pid=125065) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:59:24.884602 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-e7527660-6241-47fc-a1cb-e739748c461f tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 395dcff7-dd0a-4300-9186-fbdf380e8cd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2dd03b-4531-46f3-88da-0380e97b1bd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:59:25.152432 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-c0068de1-ee1f-47b0-bc22-160fc0321ac6 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:25.153049 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-c0068de1-ee1f-47b0-bc22-160fc0321ac6 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:25.159407 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c0068de1-ee1f-47b0-bc22-160fc0321ac6 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:25.159915 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c0068de1-ee1f-47b0-bc22-160fc0321ac6 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:25.161017 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c0068de1-ee1f-47b0-bc22-160fc0321ac6 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:25.161463 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c0068de1-ee1f-47b0-bc22-160fc0321ac6 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:25.271933 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-e7527660-6241-47fc-a1cb-e739748c461f tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.873444 Jun 03 09:59:25.273317 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 89/177] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 3 09:59:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 09:59:25.286567 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-34ebb4d0-d7af-4368-b9b4-5487a163322c tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:25.287718 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-34ebb4d0-d7af-4368-b9b4-5487a163322c tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 395dcff7-dd0a-4300-9186-fbdf380e8cd7] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:25.317250 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-c0068de1-ee1f-47b0-bc22-160fc0321ac6 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:25.330989 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-c0068de1-ee1f-47b0-bc22-160fc0321ac6 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.182907 Jun 03 09:59:25.332422 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 89/178] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:25 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:25.376038 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-34ebb4d0-d7af-4368-b9b4-5487a163322c tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:25.384663 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-34ebb4d0-d7af-4368-b9b4-5487a163322c tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7" status: 200 len: 1214 microversion: 2.1 time: 0.104057 Jun 03 09:59:25.385519 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 90/179] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:25 2022] GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7 => generated 1214 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:25.510070 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-9ca5739d-51b8-4971-8080-2957e7a437cc tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:25.510685 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-9ca5739d-51b8-4971-8080-2957e7a437cc tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:25.517602 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9ca5739d-51b8-4971-8080-2957e7a437cc tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:25.518644 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9ca5739d-51b8-4971-8080-2957e7a437cc tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:25.519747 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9ca5739d-51b8-4971-8080-2957e7a437cc tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:25.520564 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9ca5739d-51b8-4971-8080-2957e7a437cc tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:25.558204 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9ca5739d-51b8-4971-8080-2957e7a437cc tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:25.558649 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9ca5739d-51b8-4971-8080-2957e7a437cc tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:25.559109 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.objects.instance [None req-9ca5739d-51b8-4971-8080-2957e7a437cc tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lazy-loading 'fault' on Instance uuid 0fee24c1-4a54-47e9-9a0a-0726af3cf00a {{(pid=125066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:59:25.606438 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-9ca5739d-51b8-4971-8080-2957e7a437cc tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2ed7dd8d03c4c42925e3efca1915a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69776fa5af0c4573b668bbf8dc200931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:25.614471 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-9ca5739d-51b8-4971-8080-2957e7a437cc tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 200 len: 1351 microversion: 2.1 time: 0.108260 Jun 03 09:59:25.615077 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 90/180] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:25 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 1351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:26.348567 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-f54775e9-9842-4ac9-b3b8-0c8c4d0891c1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:26.349253 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-f54775e9-9842-4ac9-b3b8-0c8c4d0891c1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:26.356663 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f54775e9-9842-4ac9-b3b8-0c8c4d0891c1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:26.357056 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f54775e9-9842-4ac9-b3b8-0c8c4d0891c1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:26.357816 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f54775e9-9842-4ac9-b3b8-0c8c4d0891c1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:26.358281 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f54775e9-9842-4ac9-b3b8-0c8c4d0891c1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:26.402100 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-aec26a60-ddf3-46ad-b3b5-bf87a03353a0 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:26.402716 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-aec26a60-ddf3-46ad-b3b5-bf87a03353a0 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 395dcff7-dd0a-4300-9186-fbdf380e8cd7] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:26.488797 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-aec26a60-ddf3-46ad-b3b5-bf87a03353a0 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:26.497158 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-aec26a60-ddf3-46ad-b3b5-bf87a03353a0 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7" status: 200 len: 1214 microversion: 2.1 time: 0.099189 Jun 03 09:59:26.497738 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 91/181] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:26 2022] GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7 => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:26.520211 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f54775e9-9842-4ac9-b3b8-0c8c4d0891c1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:26.538306 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-f54775e9-9842-4ac9-b3b8-0c8c4d0891c1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.193158 Jun 03 09:59:26.539784 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 91/182] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:26 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:26.632180 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-73e9f13b-cd88-4b19-82c9-b42a6de80d72 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:26.632799 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-73e9f13b-cd88-4b19-82c9-b42a6de80d72 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:26.639554 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-73e9f13b-cd88-4b19-82c9-b42a6de80d72 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:26.640003 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-73e9f13b-cd88-4b19-82c9-b42a6de80d72 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:26.640761 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-73e9f13b-cd88-4b19-82c9-b42a6de80d72 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:26.641199 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-73e9f13b-cd88-4b19-82c9-b42a6de80d72 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:26.654863 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.wsgi [None req-73e9f13b-cd88-4b19-82c9-b42a6de80d72 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] HTTP exception thrown: Instance 0fee24c1-4a54-47e9-9a0a-0726af3cf00a could not be found. Jun 03 09:59:26.659499 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-73e9f13b-cd88-4b19-82c9-b42a6de80d72 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Request method failure captured: Jun 03 09:59:26.659499 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: request: GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a HTTP/1.1 Jun 03 09:59:26.659499 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept: application/json Jun 03 09:59:26.659499 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept-Encoding: identity Jun 03 09:59:26.659499 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Connection: close Jun 03 09:59:26.659499 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Length: 0 Jun 03 09:59:26.659499 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Type: application/json Jun 03 09:59:26.659499 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Host: 10.222.0.42 Jun 03 09:59:26.659499 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Openstack-System-Scope: None Jun 03 09:59:26.659499 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: User-Agent: python-urllib3/1.26.9 Jun 03 09:59:26.659499 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Auth-Token: gAAAAABimds1yoVjnrbCIDhZ3ZkIV3xvhMmZUc71amwWLKzrjCAMM5D7CSjmZYpR_deZiXeE2UORBgL_E6CRBC3RqTFVEMkDCyLVzcm2K3v9FXLOzyFHqlejK18jzRx4c6yj7IX8Wd7LBUVYSWY1eYa3CqmDj1lM4zBWRqKLxEyaBTVflbcLFJk Jun 03 09:59:26.659499 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Id: None Jun 03 09:59:26.659499 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Name: None Jun 03 09:59:26.659499 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Identity-Status: Confirmed Jun 03 09:59:26.659499 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Is-Admin-Project: True Jun 03 09:59:26.659499 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Id: default Jun 03 09:59:26.659499 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Name: Default Jun 03 09:59:26.659499 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Id: 69776fa5af0c4573b668bbf8dc200931 Jun 03 09:59:26.659499 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Name: tempest-DeleteServersTestJSON-1800424518 Jun 03 09:59:26.659499 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Role: member,reader Jun 03 09:59:26.659499 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Roles: member,reader Jun 03 09:59:26.661050 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/69776fa5af0c4573b668bbf8dc200931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69776fa5af0c4573b668bbf8dc200931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_69776fa5af0c4573b668bbf8dc200931", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69776fa5af0c4573b668bbf8dc200931"}]}] Jun 03 09:59:26.661050 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant: tempest-DeleteServersTestJSON-1800424518 Jun 03 09:59:26.661050 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Id: 69776fa5af0c4573b668bbf8dc200931 Jun 03 09:59:26.661050 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Name: tempest-DeleteServersTestJSON-1800424518 Jun 03 09:59:26.661050 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User: tempest-DeleteServersTestJSON-1800424518-project Jun 03 09:59:26.661050 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Id: default Jun 03 09:59:26.661050 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Name: Default Jun 03 09:59:26.661050 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Id: d2ed7dd8d03c4c42925e3efca1915a46 Jun 03 09:59:26.661050 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Name: tempest-DeleteServersTestJSON-1800424518-project Jun 03 09:59:26.661050 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: method: > Jun 03 09:59:26.661050 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: exception: Instance 0fee24c1-4a54-47e9-9a0a-0726af3cf00a could not be found. Jun 03 09:59:26.661050 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: action_args: {'id': '0fee24c1-4a54-47e9-9a0a-0726af3cf00a'} Jun 03 09:59:26.661828 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:59:26.661828 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:59:26.661828 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:59:26.661828 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:59:26.661828 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:59:26.661828 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:59:26.661828 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:59:26.661828 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:59:26.661828 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:59:26.661828 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:59:26.661828 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fee24c1-4a54-47e9-9a0a-0726af3cf00a could not be found. Jun 03 09:59:26.661828 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:59:26.661828 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:59:26.661828 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:59:26.661828 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:59:26.661828 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:59:26.661828 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:59:26.661828 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:59:26.661828 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:59:26.661828 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:59:26.663456 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:59:26.663456 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:59:26.663456 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:59:26.663456 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:59:26.663456 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:59:26.663456 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:59:26.663456 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:59:26.663456 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fee24c1-4a54-47e9-9a0a-0726af3cf00a could not be found. Jun 03 09:59:26.663456 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:59:26.663456 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:59:26.663456 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:59:26.663456 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:59:26.663456 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:59:26.663456 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:59:26.663456 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:59:26.663456 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:59:26.663456 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fee24c1-4a54-47e9-9a0a-0726af3cf00a could not be found. Jun 03 09:59:26.663456 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:59:26.665260 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-73e9f13b-cd88-4b19-82c9-b42a6de80d72 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Returning 404 to user: Instance 0fee24c1-4a54-47e9-9a0a-0726af3cf00a could not be found. {{(pid=125066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:59:26.665260 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-73e9f13b-cd88-4b19-82c9-b42a6de80d72 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 404 len: 111 microversion: 2.1 time: 0.032644 Jun 03 09:59:26.665260 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 92/183] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:26 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:59:26.770331 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-a62838a2-4b7d-473b-a0df-0ed966212881 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:26.771306 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-a62838a2-4b7d-473b-a0df-0ed966212881 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:26.777478 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a62838a2-4b7d-473b-a0df-0ed966212881 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:26.777964 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a62838a2-4b7d-473b-a0df-0ed966212881 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:26.778763 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a62838a2-4b7d-473b-a0df-0ed966212881 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:26.779233 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a62838a2-4b7d-473b-a0df-0ed966212881 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:26.794102 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.wsgi [None req-a62838a2-4b7d-473b-a0df-0ed966212881 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] HTTP exception thrown: Instance 0fee24c1-4a54-47e9-9a0a-0726af3cf00a could not be found. Jun 03 09:59:26.798453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-a62838a2-4b7d-473b-a0df-0ed966212881 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Request method failure captured: Jun 03 09:59:26.798453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: request: GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a/os-volume_attachments HTTP/1.1 Jun 03 09:59:26.798453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept: application/json Jun 03 09:59:26.798453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept-Encoding: identity Jun 03 09:59:26.798453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Connection: close Jun 03 09:59:26.798453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Length: 0 Jun 03 09:59:26.798453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Type: application/json Jun 03 09:59:26.798453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Host: 10.222.0.42 Jun 03 09:59:26.798453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Openstack-System-Scope: None Jun 03 09:59:26.798453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: User-Agent: python-urllib3/1.26.9 Jun 03 09:59:26.798453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Auth-Token: gAAAAABimds1yoVjnrbCIDhZ3ZkIV3xvhMmZUc71amwWLKzrjCAMM5D7CSjmZYpR_deZiXeE2UORBgL_E6CRBC3RqTFVEMkDCyLVzcm2K3v9FXLOzyFHqlejK18jzRx4c6yj7IX8Wd7LBUVYSWY1eYa3CqmDj1lM4zBWRqKLxEyaBTVflbcLFJk Jun 03 09:59:26.798453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Id: None Jun 03 09:59:26.798453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Name: None Jun 03 09:59:26.798453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Identity-Status: Confirmed Jun 03 09:59:26.798453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Is-Admin-Project: True Jun 03 09:59:26.798453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Id: default Jun 03 09:59:26.798453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Name: Default Jun 03 09:59:26.798453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Id: 69776fa5af0c4573b668bbf8dc200931 Jun 03 09:59:26.798453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Name: tempest-DeleteServersTestJSON-1800424518 Jun 03 09:59:26.798453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Role: member,reader Jun 03 09:59:26.798453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Roles: member,reader Jun 03 09:59:26.799770 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/69776fa5af0c4573b668bbf8dc200931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69776fa5af0c4573b668bbf8dc200931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_69776fa5af0c4573b668bbf8dc200931", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69776fa5af0c4573b668bbf8dc200931"}]}] Jun 03 09:59:26.799770 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant: tempest-DeleteServersTestJSON-1800424518 Jun 03 09:59:26.799770 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Id: 69776fa5af0c4573b668bbf8dc200931 Jun 03 09:59:26.799770 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Name: tempest-DeleteServersTestJSON-1800424518 Jun 03 09:59:26.799770 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User: tempest-DeleteServersTestJSON-1800424518-project Jun 03 09:59:26.799770 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Id: default Jun 03 09:59:26.799770 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Name: Default Jun 03 09:59:26.799770 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Id: d2ed7dd8d03c4c42925e3efca1915a46 Jun 03 09:59:26.799770 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Name: tempest-DeleteServersTestJSON-1800424518-project Jun 03 09:59:26.799770 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: method: > Jun 03 09:59:26.799770 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: exception: Instance 0fee24c1-4a54-47e9-9a0a-0726af3cf00a could not be found. Jun 03 09:59:26.799770 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: action_args: {'server_id': '0fee24c1-4a54-47e9-9a0a-0726af3cf00a'} Jun 03 09:59:26.800590 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:59:26.800590 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:59:26.800590 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:59:26.800590 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:59:26.800590 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:59:26.800590 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:59:26.800590 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:59:26.800590 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:59:26.800590 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:59:26.800590 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:59:26.800590 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fee24c1-4a54-47e9-9a0a-0726af3cf00a could not be found. Jun 03 09:59:26.800590 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:59:26.800590 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:59:26.800590 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:59:26.800590 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:59:26.800590 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:59:26.800590 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:59:26.800590 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:59:26.800590 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:59:26.800590 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:59:26.801768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:59:26.801768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 03 09:59:26.801768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 09:59:26.801768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 03 09:59:26.801768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 09:59:26.801768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 03 09:59:26.801768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 03 09:59:26.801768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:59:26.801768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:59:26.801768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fee24c1-4a54-47e9-9a0a-0726af3cf00a could not be found. Jun 03 09:59:26.801768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:59:26.801768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:59:26.801768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:59:26.801768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:59:26.801768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:59:26.801768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:59:26.801768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:59:26.801768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:59:26.801768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fee24c1-4a54-47e9-9a0a-0726af3cf00a could not be found. Jun 03 09:59:26.801768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:59:26.803029 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-a62838a2-4b7d-473b-a0df-0ed966212881 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Returning 404 to user: Instance 0fee24c1-4a54-47e9-9a0a-0726af3cf00a could not be found. {{(pid=125065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:59:26.803029 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-a62838a2-4b7d-473b-a0df-0ed966212881 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033656 Jun 03 09:59:26.803029 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 92/184] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 3 09:59:26 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:59:27.513853 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-5f9eb840-4720-4c9a-a2cf-de950f4455e3 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:27.514478 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-5f9eb840-4720-4c9a-a2cf-de950f4455e3 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 395dcff7-dd0a-4300-9186-fbdf380e8cd7] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:27.520988 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5f9eb840-4720-4c9a-a2cf-de950f4455e3 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:27.521435 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5f9eb840-4720-4c9a-a2cf-de950f4455e3 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:27.522228 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5f9eb840-4720-4c9a-a2cf-de950f4455e3 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:27.522666 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5f9eb840-4720-4c9a-a2cf-de950f4455e3 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:27.557141 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-b565c886-6c5c-4f50-a578-664df7a09e91 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:27.558600 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-b565c886-6c5c-4f50-a578-664df7a09e91 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:27.565740 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b565c886-6c5c-4f50-a578-664df7a09e91 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:27.566484 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b565c886-6c5c-4f50-a578-664df7a09e91 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:27.567283 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b565c886-6c5c-4f50-a578-664df7a09e91 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:27.567716 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b565c886-6c5c-4f50-a578-664df7a09e91 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:27.585309 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-5f9eb840-4720-4c9a-a2cf-de950f4455e3 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:27.593922 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-5f9eb840-4720-4c9a-a2cf-de950f4455e3 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7" status: 200 len: 1210 microversion: 2.1 time: 0.084254 Jun 03 09:59:27.594732 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 93/185] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:27 2022] GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7 => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:27.722425 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-b565c886-6c5c-4f50-a578-664df7a09e91 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:27.730169 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-b565c886-6c5c-4f50-a578-664df7a09e91 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.177920 Jun 03 09:59:27.730884 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 93/186] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:27 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:28.174842 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-982b43c7-6cb8-4120-b0e1-f429aefe76e1 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:28.175331 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-982b43c7-6cb8-4120-b0e1-f429aefe76e1 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:28.181194 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-982b43c7-6cb8-4120-b0e1-f429aefe76e1 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:28.181643 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-982b43c7-6cb8-4120-b0e1-f429aefe76e1 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:28.182435 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-982b43c7-6cb8-4120-b0e1-f429aefe76e1 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:28.182871 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-982b43c7-6cb8-4120-b0e1-f429aefe76e1 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:28.198608 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.wsgi [None req-982b43c7-6cb8-4120-b0e1-f429aefe76e1 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] HTTP exception thrown: Instance 0fee24c1-4a54-47e9-9a0a-0726af3cf00a could not be found. Jun 03 09:59:28.198608 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-982b43c7-6cb8-4120-b0e1-f429aefe76e1 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Request method failure captured: Jun 03 09:59:28.198608 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: request: DELETE /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a HTTP/1.1 Jun 03 09:59:28.198608 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept: application/json Jun 03 09:59:28.198608 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept-Encoding: identity Jun 03 09:59:28.198608 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Connection: close Jun 03 09:59:28.198608 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Length: 0 Jun 03 09:59:28.198608 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Type: application/json Jun 03 09:59:28.198608 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Host: 10.222.0.42 Jun 03 09:59:28.198608 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Openstack-System-Scope: None Jun 03 09:59:28.198608 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: User-Agent: python-urllib3/1.26.9 Jun 03 09:59:28.198608 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Auth-Token: gAAAAABimds1yoVjnrbCIDhZ3ZkIV3xvhMmZUc71amwWLKzrjCAMM5D7CSjmZYpR_deZiXeE2UORBgL_E6CRBC3RqTFVEMkDCyLVzcm2K3v9FXLOzyFHqlejK18jzRx4c6yj7IX8Wd7LBUVYSWY1eYa3CqmDj1lM4zBWRqKLxEyaBTVflbcLFJk Jun 03 09:59:28.198608 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Id: None Jun 03 09:59:28.198608 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Name: None Jun 03 09:59:28.198608 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Identity-Status: Confirmed Jun 03 09:59:28.198608 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Is-Admin-Project: True Jun 03 09:59:28.198608 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Id: default Jun 03 09:59:28.198608 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Name: Default Jun 03 09:59:28.198608 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Id: 69776fa5af0c4573b668bbf8dc200931 Jun 03 09:59:28.198608 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Name: tempest-DeleteServersTestJSON-1800424518 Jun 03 09:59:28.198608 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Role: member,reader Jun 03 09:59:28.198608 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Roles: member,reader Jun 03 09:59:28.203444 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/69776fa5af0c4573b668bbf8dc200931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69776fa5af0c4573b668bbf8dc200931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_69776fa5af0c4573b668bbf8dc200931", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69776fa5af0c4573b668bbf8dc200931"}]}] Jun 03 09:59:28.203444 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant: tempest-DeleteServersTestJSON-1800424518 Jun 03 09:59:28.203444 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Id: 69776fa5af0c4573b668bbf8dc200931 Jun 03 09:59:28.203444 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Name: tempest-DeleteServersTestJSON-1800424518 Jun 03 09:59:28.203444 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User: tempest-DeleteServersTestJSON-1800424518-project Jun 03 09:59:28.203444 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Id: default Jun 03 09:59:28.203444 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Name: Default Jun 03 09:59:28.203444 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Id: d2ed7dd8d03c4c42925e3efca1915a46 Jun 03 09:59:28.203444 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Name: tempest-DeleteServersTestJSON-1800424518-project Jun 03 09:59:28.203444 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: method: > Jun 03 09:59:28.203444 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: exception: Instance 0fee24c1-4a54-47e9-9a0a-0726af3cf00a could not be found. Jun 03 09:59:28.203444 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: action_args: {'id': '0fee24c1-4a54-47e9-9a0a-0726af3cf00a'} Jun 03 09:59:28.204262 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:59:28.204262 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:59:28.204262 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:59:28.204262 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:59:28.204262 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:59:28.204262 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:59:28.204262 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:59:28.204262 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:59:28.204262 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:59:28.204262 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:59:28.204262 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fee24c1-4a54-47e9-9a0a-0726af3cf00a could not be found. Jun 03 09:59:28.204262 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:59:28.204262 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:59:28.204262 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:59:28.204262 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:59:28.204262 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:59:28.204262 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:59:28.204262 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:59:28.204262 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:59:28.204262 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:59:28.205580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:59:28.205580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 09:59:28.205580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 09:59:28.205580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 09:59:28.205580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 09:59:28.205580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:59:28.205580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:59:28.205580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:59:28.205580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:59:28.205580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fee24c1-4a54-47e9-9a0a-0726af3cf00a could not be found. Jun 03 09:59:28.205580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:59:28.205580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:59:28.205580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:59:28.205580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:59:28.205580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:59:28.205580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:59:28.205580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:59:28.205580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:59:28.205580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fee24c1-4a54-47e9-9a0a-0726af3cf00a could not be found. Jun 03 09:59:28.205580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:59:28.206966 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-982b43c7-6cb8-4120-b0e1-f429aefe76e1 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Returning 404 to user: Instance 0fee24c1-4a54-47e9-9a0a-0726af3cf00a could not be found. {{(pid=125066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:59:28.206966 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-982b43c7-6cb8-4120-b0e1-f429aefe76e1 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 404 len: 111 microversion: 2.1 time: 0.028582 Jun 03 09:59:28.206966 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 94/187] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 3 09:59:28 2022] DELETE /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:59:28.211726 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-487fb683-b835-4778-817d-97c89993cb04 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:28.212185 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-487fb683-b835-4778-817d-97c89993cb04 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] [instance: 0fee24c1-4a54-47e9-9a0a-0726af3cf00a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:28.226555 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-487fb683-b835-4778-817d-97c89993cb04 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:28.227373 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-487fb683-b835-4778-817d-97c89993cb04 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:28.227800 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-487fb683-b835-4778-817d-97c89993cb04 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:28.228248 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-487fb683-b835-4778-817d-97c89993cb04 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:28.242865 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.wsgi [None req-487fb683-b835-4778-817d-97c89993cb04 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] HTTP exception thrown: Instance 0fee24c1-4a54-47e9-9a0a-0726af3cf00a could not be found. Jun 03 09:59:28.245078 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-487fb683-b835-4778-817d-97c89993cb04 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Request method failure captured: Jun 03 09:59:28.245078 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: request: GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a HTTP/1.1 Jun 03 09:59:28.245078 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept: application/json Jun 03 09:59:28.245078 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept-Encoding: identity Jun 03 09:59:28.245078 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Connection: close Jun 03 09:59:28.245078 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Length: 0 Jun 03 09:59:28.245078 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Type: application/json Jun 03 09:59:28.245078 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Host: 10.222.0.42 Jun 03 09:59:28.245078 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Openstack-System-Scope: None Jun 03 09:59:28.245078 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: User-Agent: python-urllib3/1.26.9 Jun 03 09:59:28.245078 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Auth-Token: gAAAAABimds1yoVjnrbCIDhZ3ZkIV3xvhMmZUc71amwWLKzrjCAMM5D7CSjmZYpR_deZiXeE2UORBgL_E6CRBC3RqTFVEMkDCyLVzcm2K3v9FXLOzyFHqlejK18jzRx4c6yj7IX8Wd7LBUVYSWY1eYa3CqmDj1lM4zBWRqKLxEyaBTVflbcLFJk Jun 03 09:59:28.245078 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Id: None Jun 03 09:59:28.245078 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Name: None Jun 03 09:59:28.245078 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Identity-Status: Confirmed Jun 03 09:59:28.245078 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Is-Admin-Project: True Jun 03 09:59:28.245078 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Id: default Jun 03 09:59:28.245078 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Name: Default Jun 03 09:59:28.245078 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Id: 69776fa5af0c4573b668bbf8dc200931 Jun 03 09:59:28.245078 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Name: tempest-DeleteServersTestJSON-1800424518 Jun 03 09:59:28.245078 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Role: member,reader Jun 03 09:59:28.245078 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Roles: member,reader Jun 03 09:59:28.251212 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/69776fa5af0c4573b668bbf8dc200931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69776fa5af0c4573b668bbf8dc200931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_69776fa5af0c4573b668bbf8dc200931", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69776fa5af0c4573b668bbf8dc200931"}]}] Jun 03 09:59:28.251212 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant: tempest-DeleteServersTestJSON-1800424518 Jun 03 09:59:28.251212 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Id: 69776fa5af0c4573b668bbf8dc200931 Jun 03 09:59:28.251212 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Name: tempest-DeleteServersTestJSON-1800424518 Jun 03 09:59:28.251212 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User: tempest-DeleteServersTestJSON-1800424518-project Jun 03 09:59:28.251212 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Id: default Jun 03 09:59:28.251212 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Name: Default Jun 03 09:59:28.251212 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Id: d2ed7dd8d03c4c42925e3efca1915a46 Jun 03 09:59:28.251212 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Name: tempest-DeleteServersTestJSON-1800424518-project Jun 03 09:59:28.251212 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: method: > Jun 03 09:59:28.251212 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: exception: Instance 0fee24c1-4a54-47e9-9a0a-0726af3cf00a could not be found. Jun 03 09:59:28.251212 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: action_args: {'id': '0fee24c1-4a54-47e9-9a0a-0726af3cf00a'} Jun 03 09:59:28.252695 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:59:28.252695 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:59:28.252695 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:59:28.252695 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:59:28.252695 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:59:28.252695 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:59:28.252695 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:59:28.252695 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:59:28.252695 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:59:28.252695 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:59:28.252695 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fee24c1-4a54-47e9-9a0a-0726af3cf00a could not be found. Jun 03 09:59:28.252695 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:59:28.252695 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:59:28.252695 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:59:28.252695 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:59:28.252695 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:59:28.252695 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:59:28.252695 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:59:28.252695 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:59:28.252695 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:59:28.254101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:59:28.254101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:59:28.254101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:59:28.254101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:59:28.254101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:59:28.254101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:59:28.254101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:59:28.254101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fee24c1-4a54-47e9-9a0a-0726af3cf00a could not be found. Jun 03 09:59:28.254101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:59:28.254101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:59:28.254101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:59:28.254101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:59:28.254101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:59:28.254101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:59:28.254101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:59:28.254101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:59:28.254101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fee24c1-4a54-47e9-9a0a-0726af3cf00a could not be found. Jun 03 09:59:28.254101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 09:59:28.255362 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-487fb683-b835-4778-817d-97c89993cb04 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] Returning 404 to user: Instance 0fee24c1-4a54-47e9-9a0a-0726af3cf00a could not be found. {{(pid=125065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:59:28.255362 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-487fb683-b835-4778-817d-97c89993cb04 tempest-DeleteServersTestJSON-1800424518 tempest-DeleteServersTestJSON-1800424518-project] 10.222.0.42 "GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a" status: 404 len: 111 microversion: 2.1 time: 0.042359 Jun 03 09:59:28.255362 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 94/188] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:28 2022] GET /compute/v2.1/servers/0fee24c1-4a54-47e9-9a0a-0726af3cf00a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:59:28.611589 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-7f94638b-197f-479b-8a0b-74ef8ffe504b tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:28.612194 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-7f94638b-197f-479b-8a0b-74ef8ffe504b tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 395dcff7-dd0a-4300-9186-fbdf380e8cd7] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:28.619391 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7f94638b-197f-479b-8a0b-74ef8ffe504b tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:28.619837 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7f94638b-197f-479b-8a0b-74ef8ffe504b tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:28.620774 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7f94638b-197f-479b-8a0b-74ef8ffe504b tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:28.621208 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7f94638b-197f-479b-8a0b-74ef8ffe504b tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:28.733943 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-7f94638b-197f-479b-8a0b-74ef8ffe504b tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:28.748418 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-521f5d11-9b89-4bd8-97b0-78042fba9287 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:28.751634 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-521f5d11-9b89-4bd8-97b0-78042fba9287 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:28.756335 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-7f94638b-197f-479b-8a0b-74ef8ffe504b tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7" status: 200 len: 1274 microversion: 2.1 time: 0.148556 Jun 03 09:59:28.763132 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 95/189] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:28 2022] GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7 => generated 1274 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:28.763539 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-521f5d11-9b89-4bd8-97b0-78042fba9287 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:28.764228 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-521f5d11-9b89-4bd8-97b0-78042fba9287 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:28.765316 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-521f5d11-9b89-4bd8-97b0-78042fba9287 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:28.765907 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-521f5d11-9b89-4bd8-97b0-78042fba9287 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:29.101482 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-521f5d11-9b89-4bd8-97b0-78042fba9287 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:29.111478 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-521f5d11-9b89-4bd8-97b0-78042fba9287 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.368312 Jun 03 09:59:29.113100 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 95/190] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:28 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:29.779808 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-4e40d83f-2479-4d1a-ad42-64dba284af47 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:29.781104 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-4e40d83f-2479-4d1a-ad42-64dba284af47 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 395dcff7-dd0a-4300-9186-fbdf380e8cd7] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:29.787209 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4e40d83f-2479-4d1a-ad42-64dba284af47 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:29.788086 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4e40d83f-2479-4d1a-ad42-64dba284af47 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:29.789233 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4e40d83f-2479-4d1a-ad42-64dba284af47 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:29.789912 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4e40d83f-2479-4d1a-ad42-64dba284af47 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:30.007956 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-4e40d83f-2479-4d1a-ad42-64dba284af47 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:30.020052 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-4e40d83f-2479-4d1a-ad42-64dba284af47 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7" status: 200 len: 1314 microversion: 2.1 time: 0.244132 Jun 03 09:59:30.024385 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 96/191] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:29 2022] GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:30.129258 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-465b7bf2-7336-4e19-bc46-137496262758 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:30.130164 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-465b7bf2-7336-4e19-bc46-137496262758 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:30.137228 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-465b7bf2-7336-4e19-bc46-137496262758 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:30.137981 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-465b7bf2-7336-4e19-bc46-137496262758 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:30.138750 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-465b7bf2-7336-4e19-bc46-137496262758 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:30.139187 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-465b7bf2-7336-4e19-bc46-137496262758 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:30.399521 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-465b7bf2-7336-4e19-bc46-137496262758 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:30.412501 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-465b7bf2-7336-4e19-bc46-137496262758 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.286361 Jun 03 09:59:30.423744 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 96/192] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:30 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:30.909332 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-1cd78930-0c61-4cb1-aef3-0887743ee888 req-7414b072-d256-40fd-940f-91c7581db642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "395dcff7-dd0a-4300-9186-fbdf380e8cd7", "tag": "3cad2bdc-c218-4a69-ba3b-f09c36418bdc"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:59:30.918288 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-1cd78930-0c61-4cb1-aef3-0887743ee888 req-7414b072-d256-40fd-940f-91c7581db642 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:30.918730 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-1cd78930-0c61-4cb1-aef3-0887743ee888 req-7414b072-d256-40fd-940f-91c7581db642 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:30.936846 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-1cd78930-0c61-4cb1-aef3-0887743ee888 req-7414b072-d256-40fd-940f-91c7581db642 service nova] Creating event network-changed:3cad2bdc-c218-4a69-ba3b-f09c36418bdc for instance 395dcff7-dd0a-4300-9186-fbdf380e8cd7 on hv-cinder-84456 Jun 03 09:59:30.942275 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-1cd78930-0c61-4cb1-aef3-0887743ee888 req-7414b072-d256-40fd-940f-91c7581db642 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036798 Jun 03 09:59:30.943249 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 97/193] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 09:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:59:31.041336 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-d632ddf5-cdb3-408a-a373-ea4067c05bac tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:31.042331 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-d632ddf5-cdb3-408a-a373-ea4067c05bac tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 395dcff7-dd0a-4300-9186-fbdf380e8cd7] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:31.052932 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d632ddf5-cdb3-408a-a373-ea4067c05bac tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:31.053372 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d632ddf5-cdb3-408a-a373-ea4067c05bac tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:31.069026 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d632ddf5-cdb3-408a-a373-ea4067c05bac tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:31.075261 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d632ddf5-cdb3-408a-a373-ea4067c05bac tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:31.332114 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-d632ddf5-cdb3-408a-a373-ea4067c05bac tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:31.342454 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-d632ddf5-cdb3-408a-a373-ea4067c05bac tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7" status: 200 len: 1314 microversion: 2.1 time: 0.305512 Jun 03 09:59:31.343240 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 97/194] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:31 2022] GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:31.431756 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-e16a215c-0022-4d99-a26e-8158dcd64497 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:31.432870 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-e16a215c-0022-4d99-a26e-8158dcd64497 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:31.440320 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e16a215c-0022-4d99-a26e-8158dcd64497 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:31.440764 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e16a215c-0022-4d99-a26e-8158dcd64497 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:31.441518 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e16a215c-0022-4d99-a26e-8158dcd64497 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:31.442019 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e16a215c-0022-4d99-a26e-8158dcd64497 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:31.700229 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-e16a215c-0022-4d99-a26e-8158dcd64497 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:31.707598 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-e16a215c-0022-4d99-a26e-8158dcd64497 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.280157 Jun 03 09:59:31.708164 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 98/195] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:31 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:32.361467 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-ab1cb514-93a7-4d2b-96ac-c1e929cb18ba tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:32.362187 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-ab1cb514-93a7-4d2b-96ac-c1e929cb18ba tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 395dcff7-dd0a-4300-9186-fbdf380e8cd7] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:32.368477 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ab1cb514-93a7-4d2b-96ac-c1e929cb18ba tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:32.369690 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ab1cb514-93a7-4d2b-96ac-c1e929cb18ba tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:32.370498 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ab1cb514-93a7-4d2b-96ac-c1e929cb18ba tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:32.370969 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ab1cb514-93a7-4d2b-96ac-c1e929cb18ba tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:32.397627 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:32.724687 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-d2632644-3600-4dc1-8cda-be210b8c38ff tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:32.726216 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-d2632644-3600-4dc1-8cda-be210b8c38ff tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:32.733380 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d2632644-3600-4dc1-8cda-be210b8c38ff tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:32.733851 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d2632644-3600-4dc1-8cda-be210b8c38ff tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:32.734645 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d2632644-3600-4dc1-8cda-be210b8c38ff tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:32.735085 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d2632644-3600-4dc1-8cda-be210b8c38ff tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:32.745689 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-ab1cb514-93a7-4d2b-96ac-c1e929cb18ba tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:32.754656 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-ab1cb514-93a7-4d2b-96ac-c1e929cb18ba tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7" status: 200 len: 1314 microversion: 2.1 time: 0.397779 Jun 03 09:59:32.755594 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 98/196] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:32 2022] GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:32.909060 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-d2632644-3600-4dc1-8cda-be210b8c38ff tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:32.917793 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-d2632644-3600-4dc1-8cda-be210b8c38ff tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.197747 Jun 03 09:59:32.918425 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 99/197] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:32 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:33.773349 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-d1f51db2-77bd-4a5d-abe4-c60e6e3d1fd5 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:33.774078 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-d1f51db2-77bd-4a5d-abe4-c60e6e3d1fd5 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 395dcff7-dd0a-4300-9186-fbdf380e8cd7] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:33.782000 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d1f51db2-77bd-4a5d-abe4-c60e6e3d1fd5 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:33.782674 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d1f51db2-77bd-4a5d-abe4-c60e6e3d1fd5 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:33.783442 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d1f51db2-77bd-4a5d-abe4-c60e6e3d1fd5 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:33.783871 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d1f51db2-77bd-4a5d-abe4-c60e6e3d1fd5 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:33.935102 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-9fc3f6ba-ea60-4ed5-9405-225999dfbc1e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:33.936352 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-9fc3f6ba-ea60-4ed5-9405-225999dfbc1e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:33.938305 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-d1f51db2-77bd-4a5d-abe4-c60e6e3d1fd5 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:33.943807 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9fc3f6ba-ea60-4ed5-9405-225999dfbc1e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:33.944397 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9fc3f6ba-ea60-4ed5-9405-225999dfbc1e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:33.945188 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9fc3f6ba-ea60-4ed5-9405-225999dfbc1e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:33.946030 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9fc3f6ba-ea60-4ed5-9405-225999dfbc1e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:33.946521 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-d1f51db2-77bd-4a5d-abe4-c60e6e3d1fd5 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7" status: 200 len: 1314 microversion: 2.1 time: 0.177617 Jun 03 09:59:33.947876 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 99/198] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:33 2022] GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:34.079910 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-9fc3f6ba-ea60-4ed5-9405-225999dfbc1e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:34.087650 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-9fc3f6ba-ea60-4ed5-9405-225999dfbc1e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.157732 Jun 03 09:59:34.088218 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 100/199] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:33 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:34.963407 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-01e93d34-7327-4941-9bcd-615af53ab088 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:34.965177 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-01e93d34-7327-4941-9bcd-615af53ab088 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 395dcff7-dd0a-4300-9186-fbdf380e8cd7] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:34.967038 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell0:SELECT=2 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:34.972202 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-01e93d34-7327-4941-9bcd-615af53ab088 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:34.972636 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-01e93d34-7327-4941-9bcd-615af53ab088 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:34.973525 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-01e93d34-7327-4941-9bcd-615af53ab088 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:34.973981 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-01e93d34-7327-4941-9bcd-615af53ab088 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:35.112801 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-f8e7477e-597e-435e-98c4-f8ac97060627 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:35.112801 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-f8e7477e-597e-435e-98c4-f8ac97060627 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:35.114392 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f8e7477e-597e-435e-98c4-f8ac97060627 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:35.114846 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f8e7477e-597e-435e-98c4-f8ac97060627 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:35.115610 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f8e7477e-597e-435e-98c4-f8ac97060627 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:35.116038 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f8e7477e-597e-435e-98c4-f8ac97060627 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:35.120632 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:SELECT=100 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:35.166458 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-01e93d34-7327-4941-9bcd-615af53ab088 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:35.174406 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-01e93d34-7327-4941-9bcd-615af53ab088 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7" status: 200 len: 1314 microversion: 2.1 time: 0.214706 Jun 03 09:59:35.175539 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 100/200] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:34 2022] GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:35.249705 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-f8e7477e-597e-435e-98c4-f8ac97060627 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:35.257378 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-f8e7477e-597e-435e-98c4-f8ac97060627 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.156578 Jun 03 09:59:35.257966 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 101/201] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:35 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:36.192015 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-4fb371fd-1718-471c-84e1-24b643304972 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:36.192701 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-4fb371fd-1718-471c-84e1-24b643304972 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 395dcff7-dd0a-4300-9186-fbdf380e8cd7] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:36.199041 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell0:SELECT=8 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:36.202521 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4fb371fd-1718-471c-84e1-24b643304972 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:36.202978 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4fb371fd-1718-471c-84e1-24b643304972 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:36.203880 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4fb371fd-1718-471c-84e1-24b643304972 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:36.204260 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4fb371fd-1718-471c-84e1-24b643304972 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:36.276007 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-0af4ce06-7c6c-4816-a11a-1b4271f644b4 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:36.277156 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-0af4ce06-7c6c-4816-a11a-1b4271f644b4 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:36.283816 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0af4ce06-7c6c-4816-a11a-1b4271f644b4 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:36.284277 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0af4ce06-7c6c-4816-a11a-1b4271f644b4 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:36.285049 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0af4ce06-7c6c-4816-a11a-1b4271f644b4 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:36.285488 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0af4ce06-7c6c-4816-a11a-1b4271f644b4 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:36.425755 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-4fb371fd-1718-471c-84e1-24b643304972 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:36.447436 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-4fb371fd-1718-471c-84e1-24b643304972 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7" status: 200 len: 1314 microversion: 2.1 time: 0.254478 Jun 03 09:59:36.448097 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 101/202] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:36 2022] GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:36.460442 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-0af4ce06-7c6c-4816-a11a-1b4271f644b4 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:36.468573 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-0af4ce06-7c6c-4816-a11a-1b4271f644b4 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.197378 Jun 03 09:59:36.469158 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 102/203] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:36 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:37.464379 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-27555f03-1690-4a71-996c-4524a964f477 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:37.464983 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-27555f03-1690-4a71-996c-4524a964f477 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 395dcff7-dd0a-4300-9186-fbdf380e8cd7] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:37.471536 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-27555f03-1690-4a71-996c-4524a964f477 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:37.472066 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-27555f03-1690-4a71-996c-4524a964f477 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:37.472726 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-27555f03-1690-4a71-996c-4524a964f477 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:37.473155 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-27555f03-1690-4a71-996c-4524a964f477 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:37.486245 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-5bbf9c74-76d4-4755-8b60-079586956088 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:37.486860 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-5bbf9c74-76d4-4755-8b60-079586956088 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:37.488839 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell0:SELECT=2 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:37.493705 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5bbf9c74-76d4-4755-8b60-079586956088 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:37.494768 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5bbf9c74-76d4-4755-8b60-079586956088 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:37.495561 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5bbf9c74-76d4-4755-8b60-079586956088 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:37.495995 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5bbf9c74-76d4-4755-8b60-079586956088 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:37.673700 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-27555f03-1690-4a71-996c-4524a964f477 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:37.682329 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-27555f03-1690-4a71-996c-4524a964f477 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7" status: 200 len: 1314 microversion: 2.1 time: 0.221811 Jun 03 09:59:37.683225 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 102/204] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:37 2022] GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:37.696218 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-5bbf9c74-76d4-4755-8b60-079586956088 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:37.704364 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-5bbf9c74-76d4-4755-8b60-079586956088 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.222659 Jun 03 09:59:37.704949 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 103/205] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:37 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:38.042516 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-4988c29d-5710-4062-8774-722c81fe1eb6 req-aced0b8e-14a8-4a0f-ba78-000ddb5e1a51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "395dcff7-dd0a-4300-9186-fbdf380e8cd7", "name": "network-vif-plugged", "status": "completed", "tag": "3cad2bdc-c218-4a69-ba3b-f09c36418bdc"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:59:38.054233 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-4988c29d-5710-4062-8774-722c81fe1eb6 req-aced0b8e-14a8-4a0f-ba78-000ddb5e1a51 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:38.055285 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-4988c29d-5710-4062-8774-722c81fe1eb6 req-aced0b8e-14a8-4a0f-ba78-000ddb5e1a51 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:38.068197 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-4988c29d-5710-4062-8774-722c81fe1eb6 req-aced0b8e-14a8-4a0f-ba78-000ddb5e1a51 service nova] Creating event network-vif-plugged:3cad2bdc-c218-4a69-ba3b-f09c36418bdc for instance 395dcff7-dd0a-4300-9186-fbdf380e8cd7 on hv-cinder-84456 Jun 03 09:59:38.074715 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-4988c29d-5710-4062-8774-722c81fe1eb6 req-aced0b8e-14a8-4a0f-ba78-000ddb5e1a51 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035476 Jun 03 09:59:38.075328 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 103/206] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 09:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:59:38.699957 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-487401ba-393b-4693-a8a8-2bb0b000a4cc tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:38.700569 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-487401ba-393b-4693-a8a8-2bb0b000a4cc tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 395dcff7-dd0a-4300-9186-fbdf380e8cd7] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:38.706740 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-487401ba-393b-4693-a8a8-2bb0b000a4cc tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:38.707182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-487401ba-393b-4693-a8a8-2bb0b000a4cc tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:38.707928 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-487401ba-393b-4693-a8a8-2bb0b000a4cc tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:38.708360 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-487401ba-393b-4693-a8a8-2bb0b000a4cc tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:38.722672 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-442a55bd-c39b-41a0-b3a4-a99bbf056dc0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:38.723603 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-442a55bd-c39b-41a0-b3a4-a99bbf056dc0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:38.731762 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-442a55bd-c39b-41a0-b3a4-a99bbf056dc0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:38.732381 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-442a55bd-c39b-41a0-b3a4-a99bbf056dc0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:38.733223 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-442a55bd-c39b-41a0-b3a4-a99bbf056dc0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:38.733768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-442a55bd-c39b-41a0-b3a4-a99bbf056dc0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:38.919301 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-487401ba-393b-4693-a8a8-2bb0b000a4cc tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:38.930408 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-487401ba-393b-4693-a8a8-2bb0b000a4cc tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7" status: 200 len: 1314 microversion: 2.1 time: 0.232347 Jun 03 09:59:38.930408 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 104/207] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:38 2022] GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:38.930586 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-442a55bd-c39b-41a0-b3a4-a99bbf056dc0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:38.938922 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-442a55bd-c39b-41a0-b3a4-a99bbf056dc0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.220892 Jun 03 09:59:38.939500 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 104/208] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:38 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:39.945448 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-e7b7cf1c-bb50-4ced-a082-496f5b5f8b50 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:39.946012 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-e7b7cf1c-bb50-4ced-a082-496f5b5f8b50 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 395dcff7-dd0a-4300-9186-fbdf380e8cd7] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:39.952085 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e7b7cf1c-bb50-4ced-a082-496f5b5f8b50 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:39.952610 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e7b7cf1c-bb50-4ced-a082-496f5b5f8b50 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:39.953384 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e7b7cf1c-bb50-4ced-a082-496f5b5f8b50 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:39.953825 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e7b7cf1c-bb50-4ced-a082-496f5b5f8b50 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:39.956048 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-ab056b08-c0ed-4eeb-8dec-1a3744b85e0e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:39.956655 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-ab056b08-c0ed-4eeb-8dec-1a3744b85e0e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:39.963221 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ab056b08-c0ed-4eeb-8dec-1a3744b85e0e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:39.963703 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ab056b08-c0ed-4eeb-8dec-1a3744b85e0e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:39.964413 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ab056b08-c0ed-4eeb-8dec-1a3744b85e0e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:39.964837 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ab056b08-c0ed-4eeb-8dec-1a3744b85e0e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:40.155255 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-e7b7cf1c-bb50-4ced-a082-496f5b5f8b50 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:40.158148 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-ab056b08-c0ed-4eeb-8dec-1a3744b85e0e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:40.162785 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-e7b7cf1c-bb50-4ced-a082-496f5b5f8b50 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7" status: 200 len: 1314 microversion: 2.1 time: 0.221249 Jun 03 09:59:40.163489 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 105/209] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:39 2022] GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:40.168993 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-ab056b08-c0ed-4eeb-8dec-1a3744b85e0e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.216923 Jun 03 09:59:40.169721 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 105/210] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:39 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:41.180734 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-ef0c763c-b49b-45e8-a4ac-54b675e28aad tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:41.181453 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-ef0c763c-b49b-45e8-a4ac-54b675e28aad tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 395dcff7-dd0a-4300-9186-fbdf380e8cd7] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:41.185824 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-49159c64-1fb4-4dee-868c-4106626a5dab tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:41.186564 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-49159c64-1fb4-4dee-868c-4106626a5dab tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:41.187650 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ef0c763c-b49b-45e8-a4ac-54b675e28aad tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:41.188253 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ef0c763c-b49b-45e8-a4ac-54b675e28aad tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:41.188913 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ef0c763c-b49b-45e8-a4ac-54b675e28aad tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:41.189354 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ef0c763c-b49b-45e8-a4ac-54b675e28aad tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:41.193750 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-49159c64-1fb4-4dee-868c-4106626a5dab tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:41.194292 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-49159c64-1fb4-4dee-868c-4106626a5dab tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:41.195111 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-49159c64-1fb4-4dee-868c-4106626a5dab tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:41.195632 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-49159c64-1fb4-4dee-868c-4106626a5dab tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:41.393333 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-49159c64-1fb4-4dee-868c-4106626a5dab tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:41.396513 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-ef0c763c-b49b-45e8-a4ac-54b675e28aad tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:41.401770 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-49159c64-1fb4-4dee-868c-4106626a5dab tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.219874 Jun 03 09:59:41.402378 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 106/211] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:41 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:41.409009 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-ef0c763c-b49b-45e8-a4ac-54b675e28aad tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7" status: 200 len: 1314 microversion: 2.1 time: 0.227722 Jun 03 09:59:41.409009 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 106/212] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:41 2022] GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:42.420221 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-19f6ae14-8f93-4bac-9a38-ac566b46057c tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:42.420679 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-c2ab1e5a-feb1-44c4-8426-0d54fab90b69 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:42.421037 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-19f6ae14-8f93-4bac-9a38-ac566b46057c tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 395dcff7-dd0a-4300-9186-fbdf380e8cd7] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:42.421127 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-c2ab1e5a-feb1-44c4-8426-0d54fab90b69 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:42.423003 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_api:SELECT=62 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:42.427685 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c2ab1e5a-feb1-44c4-8426-0d54fab90b69 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:42.427863 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-19f6ae14-8f93-4bac-9a38-ac566b46057c tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:42.428131 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c2ab1e5a-feb1-44c4-8426-0d54fab90b69 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:42.428242 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-19f6ae14-8f93-4bac-9a38-ac566b46057c tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:42.428917 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c2ab1e5a-feb1-44c4-8426-0d54fab90b69 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:42.429032 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-19f6ae14-8f93-4bac-9a38-ac566b46057c tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:42.429348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c2ab1e5a-feb1-44c4-8426-0d54fab90b69 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:42.429457 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-19f6ae14-8f93-4bac-9a38-ac566b46057c tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:42.690211 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-19f6ae14-8f93-4bac-9a38-ac566b46057c tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:42.701695 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-19f6ae14-8f93-4bac-9a38-ac566b46057c tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7" status: 200 len: 1314 microversion: 2.1 time: 0.285120 Jun 03 09:59:42.702589 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 107/213] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:42 2022] GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:42.714120 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-c2ab1e5a-feb1-44c4-8426-0d54fab90b69 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:42.725135 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-c2ab1e5a-feb1-44c4-8426-0d54fab90b69 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.310163 Jun 03 09:59:42.735524 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 107/214] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:42 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:43.721212 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-738848e8-d0b3-477d-9943-d2aa170768f0 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:43.724286 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-738848e8-d0b3-477d-9943-d2aa170768f0 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 395dcff7-dd0a-4300-9186-fbdf380e8cd7] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:43.731487 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-738848e8-d0b3-477d-9943-d2aa170768f0 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:43.731968 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-738848e8-d0b3-477d-9943-d2aa170768f0 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:43.732773 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-738848e8-d0b3-477d-9943-d2aa170768f0 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:43.733207 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-738848e8-d0b3-477d-9943-d2aa170768f0 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:43.742615 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-3763a294-7268-476f-8314-5f881399b9e8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:43.744703 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-3763a294-7268-476f-8314-5f881399b9e8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:43.752224 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3763a294-7268-476f-8314-5f881399b9e8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:43.754638 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3763a294-7268-476f-8314-5f881399b9e8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:43.754638 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3763a294-7268-476f-8314-5f881399b9e8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:43.754638 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3763a294-7268-476f-8314-5f881399b9e8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:43.960960 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-3763a294-7268-476f-8314-5f881399b9e8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:43.963267 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-738848e8-d0b3-477d-9943-d2aa170768f0 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:43.972195 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-738848e8-d0b3-477d-9943-d2aa170768f0 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7" status: 200 len: 1498 microversion: 2.1 time: 0.254789 Jun 03 09:59:43.973925 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 108/215] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:43 2022] GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7 => generated 1498 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:43.974776 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-3763a294-7268-476f-8314-5f881399b9e8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.236346 Jun 03 09:59:43.975347 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 108/216] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:43 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:44.991627 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-70a1b200-d32b-451c-82ec-81007d1d800b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:44.992234 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-70a1b200-d32b-451c-82ec-81007d1d800b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:44.999045 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-70a1b200-d32b-451c-82ec-81007d1d800b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:44.999516 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-70a1b200-d32b-451c-82ec-81007d1d800b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:45.000269 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-70a1b200-d32b-451c-82ec-81007d1d800b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:45.000711 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-70a1b200-d32b-451c-82ec-81007d1d800b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:45.186766 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-70a1b200-d32b-451c-82ec-81007d1d800b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:45.204014 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-70a1b200-d32b-451c-82ec-81007d1d800b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.212583 Jun 03 09:59:45.207362 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 109/217] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:44 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:45.242090 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-9f347c11-1f9d-4f25-9b2d-82cef09aa123 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:45.242628 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-9f347c11-1f9d-4f25-9b2d-82cef09aa123 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 395dcff7-dd0a-4300-9186-fbdf380e8cd7] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:45.249221 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9f347c11-1f9d-4f25-9b2d-82cef09aa123 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:45.249665 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9f347c11-1f9d-4f25-9b2d-82cef09aa123 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:45.250467 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9f347c11-1f9d-4f25-9b2d-82cef09aa123 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:45.251009 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9f347c11-1f9d-4f25-9b2d-82cef09aa123 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:45.276032 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-9f347c11-1f9d-4f25-9b2d-82cef09aa123 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 395dcff7-dd0a-4300-9186-fbdf380e8cd7] Going to try to terminate instance {{(pid=125066) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 09:59:45.682671 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-9f347c11-1f9d-4f25-9b2d-82cef09aa123 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "DELETE /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7" status: 204 len: 0 microversion: 2.1 time: 0.455109 Jun 03 09:59:45.683629 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 109/218] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 3 09:59:45 2022] DELETE /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 09:59:45.692102 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-41cac0e1-763f-4813-9d1f-6e7455627c90 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:45.692905 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-41cac0e1-763f-4813-9d1f-6e7455627c90 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 395dcff7-dd0a-4300-9186-fbdf380e8cd7] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:45.699924 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-41cac0e1-763f-4813-9d1f-6e7455627c90 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:45.700385 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-41cac0e1-763f-4813-9d1f-6e7455627c90 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:45.701207 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-41cac0e1-763f-4813-9d1f-6e7455627c90 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:45.701734 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-41cac0e1-763f-4813-9d1f-6e7455627c90 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:45.836017 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-41cac0e1-763f-4813-9d1f-6e7455627c90 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:45.844678 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-41cac0e1-763f-4813-9d1f-6e7455627c90 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7" status: 200 len: 1504 microversion: 2.1 time: 0.156537 Jun 03 09:59:45.845307 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 110/219] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:45 2022] GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:46.221938 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-270c8ff1-2f75-429e-aee1-c013533db06c tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:46.223258 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-270c8ff1-2f75-429e-aee1-c013533db06c tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:46.232510 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-270c8ff1-2f75-429e-aee1-c013533db06c tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:46.232961 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-270c8ff1-2f75-429e-aee1-c013533db06c tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:46.233735 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-270c8ff1-2f75-429e-aee1-c013533db06c tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:46.234200 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-270c8ff1-2f75-429e-aee1-c013533db06c tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:46.382596 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-270c8ff1-2f75-429e-aee1-c013533db06c tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:46.391141 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-270c8ff1-2f75-429e-aee1-c013533db06c tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1519 microversion: 2.1 time: 0.173684 Jun 03 09:59:46.391799 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 110/220] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:46 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:46.864922 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-f144383a-0f66-435b-bf0c-f8e7505ad578 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:46.865821 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-f144383a-0f66-435b-bf0c-f8e7505ad578 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 395dcff7-dd0a-4300-9186-fbdf380e8cd7] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:46.879356 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f144383a-0f66-435b-bf0c-f8e7505ad578 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:46.881914 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f144383a-0f66-435b-bf0c-f8e7505ad578 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:46.881914 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f144383a-0f66-435b-bf0c-f8e7505ad578 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:46.882469 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f144383a-0f66-435b-bf0c-f8e7505ad578 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:47.051760 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f144383a-0f66-435b-bf0c-f8e7505ad578 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:47.056530 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-f144383a-0f66-435b-bf0c-f8e7505ad578 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7" status: 200 len: 1504 microversion: 2.1 time: 0.197174 Jun 03 09:59:47.057100 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 111/221] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:46 2022] GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7 => generated 1504 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:47.407785 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-4bde7d96-232c-460a-bcb4-5c6574a939cd tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:47.408553 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-4bde7d96-232c-460a-bcb4-5c6574a939cd tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:47.414638 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4bde7d96-232c-460a-bcb4-5c6574a939cd tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:47.415173 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4bde7d96-232c-460a-bcb4-5c6574a939cd tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:47.416011 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4bde7d96-232c-460a-bcb4-5c6574a939cd tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:47.416499 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4bde7d96-232c-460a-bcb4-5c6574a939cd tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:47.609607 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-4bde7d96-232c-460a-bcb4-5c6574a939cd tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:47.620904 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-4bde7d96-232c-460a-bcb4-5c6574a939cd tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1499 microversion: 2.1 time: 0.216788 Jun 03 09:59:47.621688 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 111/222] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:47 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1499 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:47.638005 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-aa514d30-6ca3-4a3a-8ded-227a83da4156 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:47.638736 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-aa514d30-6ca3-4a3a-8ded-227a83da4156 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:47.644929 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-aa514d30-6ca3-4a3a-8ded-227a83da4156 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:47.645467 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-aa514d30-6ca3-4a3a-8ded-227a83da4156 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:47.646235 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-aa514d30-6ca3-4a3a-8ded-227a83da4156 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:47.646946 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-aa514d30-6ca3-4a3a-8ded-227a83da4156 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:47.889640 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-aa514d30-6ca3-4a3a-8ded-227a83da4156 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:47.904038 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-aa514d30-6ca3-4a3a-8ded-227a83da4156 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 200 len: 1514 microversion: 2.1 time: 0.270519 Jun 03 09:59:47.907129 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 112/223] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:47 2022] GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 1514 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:48.075425 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-4fcf262d-df53-444c-b6a5-889a93851edb tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:48.076035 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-4fcf262d-df53-444c-b6a5-889a93851edb tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 395dcff7-dd0a-4300-9186-fbdf380e8cd7] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:48.082672 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4fcf262d-df53-444c-b6a5-889a93851edb tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:48.083047 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4fcf262d-df53-444c-b6a5-889a93851edb tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:48.084223 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4fcf262d-df53-444c-b6a5-889a93851edb tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:48.084677 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4fcf262d-df53-444c-b6a5-889a93851edb tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:48.333683 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-4fcf262d-df53-444c-b6a5-889a93851edb tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:48.341633 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-4fcf262d-df53-444c-b6a5-889a93851edb tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7" status: 200 len: 1504 microversion: 2.1 time: 0.271155 Jun 03 09:59:48.342262 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 112/224] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:48 2022] GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7 => generated 1504 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:48.616570 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-09a7fdf7-8de8-46d1-abec-d11c84153849 req-70470db1-5bea-4c2c-bf77-f28f47c37a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "395dcff7-dd0a-4300-9186-fbdf380e8cd7", "name": "network-vif-deleted", "tag": "3cad2bdc-c218-4a69-ba3b-f09c36418bdc"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:59:48.620152 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:48.625303 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-09a7fdf7-8de8-46d1-abec-d11c84153849 req-70470db1-5bea-4c2c-bf77-f28f47c37a2b service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:48.625742 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-09a7fdf7-8de8-46d1-abec-d11c84153849 req-70470db1-5bea-4c2c-bf77-f28f47c37a2b service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:48.637980 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-09a7fdf7-8de8-46d1-abec-d11c84153849 req-70470db1-5bea-4c2c-bf77-f28f47c37a2b service nova] Creating event network-vif-deleted:3cad2bdc-c218-4a69-ba3b-f09c36418bdc for instance 395dcff7-dd0a-4300-9186-fbdf380e8cd7 on hv-cinder-84456 Jun 03 09:59:48.642894 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-09a7fdf7-8de8-46d1-abec-d11c84153849 req-70470db1-5bea-4c2c-bf77-f28f47c37a2b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029978 Jun 03 09:59:48.643580 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 113/225] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 09:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:59:49.360728 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-47fe8e37-e86b-4023-8163-63685391be1f tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:49.365168 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-47fe8e37-e86b-4023-8163-63685391be1f tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 395dcff7-dd0a-4300-9186-fbdf380e8cd7] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:49.369141 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-47fe8e37-e86b-4023-8163-63685391be1f tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:49.379928 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-47fe8e37-e86b-4023-8163-63685391be1f tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:49.379928 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-47fe8e37-e86b-4023-8163-63685391be1f tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:49.379928 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-47fe8e37-e86b-4023-8163-63685391be1f tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:49.412217 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-47fe8e37-e86b-4023-8163-63685391be1f tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:49.412697 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-47fe8e37-e86b-4023-8163-63685391be1f tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:49.413153 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.objects.instance [None req-47fe8e37-e86b-4023-8163-63685391be1f tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lazy-loading 'fault' on Instance uuid 395dcff7-dd0a-4300-9186-fbdf380e8cd7 {{(pid=125066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:59:49.463730 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-47fe8e37-e86b-4023-8163-63685391be1f tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:49.471602 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-47fe8e37-e86b-4023-8163-63685391be1f tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7" status: 200 len: 1304 microversion: 2.1 time: 0.116527 Jun 03 09:59:49.472668 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 113/226] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:49 2022] GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7 => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:50.065289 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-73f43f61-64f4-4b9f-86aa-05d61705cc89 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:59:50.066875 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-73f43f61-64f4-4b9f-86aa-05d61705cc89 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:50.075003 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-73f43f61-64f4-4b9f-86aa-05d61705cc89 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:50.075710 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-73f43f61-64f4-4b9f-86aa-05d61705cc89 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:50.076702 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-73f43f61-64f4-4b9f-86aa-05d61705cc89 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:50.077256 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-73f43f61-64f4-4b9f-86aa-05d61705cc89 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:50.102704 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.objects.instance [None req-73f43f61-64f4-4b9f-86aa-05d61705cc89 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lazy-loading 'flavor' on Instance uuid 28ff128f-ff5e-4889-9f83-bdfb4b86a83d {{(pid=125065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:59:50.276946 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:50.488395 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-125af707-9a9a-4822-b5a1-eaa5305fab14 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:50.489114 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-125af707-9a9a-4822-b5a1-eaa5305fab14 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 395dcff7-dd0a-4300-9186-fbdf380e8cd7] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:50.495356 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-125af707-9a9a-4822-b5a1-eaa5305fab14 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:50.495858 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-125af707-9a9a-4822-b5a1-eaa5305fab14 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:50.496646 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-125af707-9a9a-4822-b5a1-eaa5305fab14 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:50.497082 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-125af707-9a9a-4822-b5a1-eaa5305fab14 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:50.511107 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.wsgi [None req-125af707-9a9a-4822-b5a1-eaa5305fab14 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] HTTP exception thrown: Instance 395dcff7-dd0a-4300-9186-fbdf380e8cd7 could not be found. Jun 03 09:59:50.512992 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-125af707-9a9a-4822-b5a1-eaa5305fab14 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Request method failure captured: Jun 03 09:59:50.512992 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: request: GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7 HTTP/1.1 Jun 03 09:59:50.512992 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept: application/json Jun 03 09:59:50.512992 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept-Encoding: identity Jun 03 09:59:50.512992 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Connection: close Jun 03 09:59:50.512992 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Length: 0 Jun 03 09:59:50.512992 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Type: application/json Jun 03 09:59:50.512992 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Host: 10.222.0.42 Jun 03 09:59:50.512992 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Openstack-System-Scope: None Jun 03 09:59:50.512992 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: User-Agent: python-urllib3/1.26.9 Jun 03 09:59:50.512992 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Auth-Token: gAAAAABimdt6_wxcFHi6XTjBtO5P5G9PuiMEej89QmXD-o-neLkoHBvJLn94NISmqUCNNuIgFphInFUxeIrvVMgi6Dc3NV60kGybnSL9fYW4fKy6w9_ryQIvNS60pbrz6Bfcv8lws-6uFQlrtFA1eqtlt9MqW1LeDWL-Xg1UzRcpC8yjeq6CWXc Jun 03 09:59:50.512992 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Id: None Jun 03 09:59:50.512992 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Name: None Jun 03 09:59:50.512992 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Identity-Status: Confirmed Jun 03 09:59:50.512992 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Is-Admin-Project: True Jun 03 09:59:50.512992 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Id: default Jun 03 09:59:50.512992 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Name: Default Jun 03 09:59:50.512992 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Id: 4e1793ba5f584cb0a9005c50d80c5c06 Jun 03 09:59:50.512992 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Name: tempest-VolumesActionsTest-1580277483 Jun 03 09:59:50.512992 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Role: member,reader Jun 03 09:59:50.512992 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Roles: member,reader Jun 03 09:59:50.514522 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4e1793ba5f584cb0a9005c50d80c5c06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e1793ba5f584cb0a9005c50d80c5c06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4e1793ba5f584cb0a9005c50d80c5c06", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e1793ba5f584cb0a9005c50d80c5c06"}]}] Jun 03 09:59:50.514522 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant: tempest-VolumesActionsTest-1580277483 Jun 03 09:59:50.514522 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Id: 4e1793ba5f584cb0a9005c50d80c5c06 Jun 03 09:59:50.514522 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Name: tempest-VolumesActionsTest-1580277483 Jun 03 09:59:50.514522 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User: tempest-VolumesActionsTest-1580277483-project Jun 03 09:59:50.514522 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Id: default Jun 03 09:59:50.514522 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Name: Default Jun 03 09:59:50.514522 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Id: 3dd300436c9545faa56d60ac290bc987 Jun 03 09:59:50.514522 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Name: tempest-VolumesActionsTest-1580277483-project Jun 03 09:59:50.514522 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: method: > Jun 03 09:59:50.514522 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: exception: Instance 395dcff7-dd0a-4300-9186-fbdf380e8cd7 could not be found. Jun 03 09:59:50.514522 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: action_args: {'id': '395dcff7-dd0a-4300-9186-fbdf380e8cd7'} Jun 03 09:59:50.515319 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:59:50.515319 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:59:50.515319 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:59:50.515319 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:59:50.515319 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:59:50.515319 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:59:50.515319 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:59:50.515319 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:59:50.515319 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:59:50.515319 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:59:50.515319 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 395dcff7-dd0a-4300-9186-fbdf380e8cd7 could not be found. Jun 03 09:59:50.515319 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:59:50.515319 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:59:50.515319 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:59:50.515319 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:59:50.515319 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:59:50.515319 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:59:50.515319 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:59:50.515319 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:59:50.515319 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:59:50.516597 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:59:50.516597 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:59:50.516597 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:59:50.516597 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:59:50.516597 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:59:50.516597 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:59:50.516597 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:59:50.516597 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 395dcff7-dd0a-4300-9186-fbdf380e8cd7 could not be found. Jun 03 09:59:50.516597 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:59:50.516597 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:59:50.516597 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:59:50.516597 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:59:50.516597 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:59:50.516597 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:59:50.516597 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:59:50.516597 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:59:50.516597 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 395dcff7-dd0a-4300-9186-fbdf380e8cd7 could not be found. Jun 03 09:59:50.516597 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 09:59:50.517758 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-125af707-9a9a-4822-b5a1-eaa5305fab14 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Returning 404 to user: Instance 395dcff7-dd0a-4300-9186-fbdf380e8cd7 could not be found. {{(pid=125066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:59:50.517758 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-125af707-9a9a-4822-b5a1-eaa5305fab14 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7" status: 404 len: 111 microversion: 2.1 time: 0.029974 Jun 03 09:59:50.517758 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 114/227] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:50 2022] GET /compute/v2.1/servers/395dcff7-dd0a-4300-9186-fbdf380e8cd7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 09:59:50.555194 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-73f43f61-64f4-4b9f-86aa-05d61705cc89 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "POST /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d/action" status: 200 len: 32 microversion: 2.1 time: 0.494631 Jun 03 09:59:50.555984 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 114/228] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jun 3 09:59:50 2022] POST /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d/action => generated 32 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 09:59:50.567036 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-99e2978c-649a-4cde-aa2a-a8b1e22a9034 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:50.567655 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-99e2978c-649a-4cde-aa2a-a8b1e22a9034 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:50.574237 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-99e2978c-649a-4cde-aa2a-a8b1e22a9034 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:50.574690 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-99e2978c-649a-4cde-aa2a-a8b1e22a9034 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:50.575461 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-99e2978c-649a-4cde-aa2a-a8b1e22a9034 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:50.575900 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-99e2978c-649a-4cde-aa2a-a8b1e22a9034 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:50.622385 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-dabd050b-4a86-4670-ae87-c065a128b2a7 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1841053321", "imageRef": "0d2dd03b-4531-46f3-88da-0380e97b1bd4", "flavorRef": "452", "networks": [{"uuid": "98a7d991-7855-4bdc-8799-20026edb30df"}]}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:59:50.677440 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.network.neutron [None req-dabd050b-4a86-4670-ae87-c065a128b2a7 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] validate_networks() for [('98a7d991-7855-4bdc-8799-20026edb30df', None, None, None, None, None)] {{(pid=125065) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:59:50.822843 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-99e2978c-649a-4cde-aa2a-a8b1e22a9034 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:50.850287 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-99e2978c-649a-4cde-aa2a-a8b1e22a9034 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 200 len: 1520 microversion: 2.1 time: 0.283444 Jun 03 09:59:50.850287 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 115/229] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:50 2022] GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 1520 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:51.331123 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-dabd050b-4a86-4670-ae87-c065a128b2a7 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Flavor limits 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:59:51.331583 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-dabd050b-4a86-4670-ae87-c065a128b2a7 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Image limits 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:59:51.332147 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-dabd050b-4a86-4670-ae87-c065a128b2a7 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Flavor pref 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:59:51.332617 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-dabd050b-4a86-4670-ae87-c065a128b2a7 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Image pref 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:59:51.333108 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-dabd050b-4a86-4670-ae87-c065a128b2a7 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:59:51.342028 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-dabd050b-4a86-4670-ae87-c065a128b2a7 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:51.342547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-dabd050b-4a86-4670-ae87-c065a128b2a7 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:51.343435 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-dabd050b-4a86-4670-ae87-c065a128b2a7 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:51.344055 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-dabd050b-4a86-4670-ae87-c065a128b2a7 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:51.360716 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.quota [None req-dabd050b-4a86-4670-ae87-c065a128b2a7 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Getting quotas for project 4e1793ba5f584cb0a9005c50d80c5c06. Resources: {'ram', 'instances', 'cores'} {{(pid=125065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:59:51.365122 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.quota [None req-dabd050b-4a86-4670-ae87-c065a128b2a7 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Getting quotas for user 3dd300436c9545faa56d60ac290bc987 and project 4e1793ba5f584cb0a9005c50d80c5c06. Resources: {'ram', 'instances', 'cores'} {{(pid=125065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:59:51.377029 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-dabd050b-4a86-4670-ae87-c065a128b2a7 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Going to run 1 instances... {{(pid=125065) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:59:51.379480 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-dabd050b-4a86-4670-ae87-c065a128b2a7 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 321fb69e-316f-4254-93dc-d30bd9128a63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2dd03b-4531-46f3-88da-0380e97b1bd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:59:51.577510 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-dabd050b-4a86-4670-ae87-c065a128b2a7 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.959259 Jun 03 09:59:51.578861 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 115/230] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 3 09:59:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 03 09:59:51.590202 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-f462d81f-e95e-45c4-a86d-ce3d52cc780a tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:51.590997 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-f462d81f-e95e-45c4-a86d-ce3d52cc780a tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 321fb69e-316f-4254-93dc-d30bd9128a63] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:51.664279 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-f462d81f-e95e-45c4-a86d-ce3d52cc780a tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:51.671887 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-f462d81f-e95e-45c4-a86d-ce3d52cc780a tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63" status: 200 len: 1214 microversion: 2.1 time: 0.086509 Jun 03 09:59:51.672673 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 116/231] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:51 2022] GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:51.867163 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-7f2522d4-6e44-43f1-8647-928931ec0ada tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:51.867794 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-7f2522d4-6e44-43f1-8647-928931ec0ada tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:51.876002 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7f2522d4-6e44-43f1-8647-928931ec0ada tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:51.876451 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7f2522d4-6e44-43f1-8647-928931ec0ada tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:51.877376 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7f2522d4-6e44-43f1-8647-928931ec0ada tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:51.878066 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7f2522d4-6e44-43f1-8647-928931ec0ada tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:52.031633 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-7f2522d4-6e44-43f1-8647-928931ec0ada tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:52.039846 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-7f2522d4-6e44-43f1-8647-928931ec0ada tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 200 len: 1520 microversion: 2.1 time: 0.177618 Jun 03 09:59:52.040597 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 116/232] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:51 2022] GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:52.688545 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-1eb3a17c-d7da-457c-9f94-53e09209751d tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:52.689142 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-1eb3a17c-d7da-457c-9f94-53e09209751d tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 321fb69e-316f-4254-93dc-d30bd9128a63] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:52.695512 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1eb3a17c-d7da-457c-9f94-53e09209751d tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:52.695992 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1eb3a17c-d7da-457c-9f94-53e09209751d tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:52.696758 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1eb3a17c-d7da-457c-9f94-53e09209751d tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:52.697194 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1eb3a17c-d7da-457c-9f94-53e09209751d tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:52.714680 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:52.767582 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-1eb3a17c-d7da-457c-9f94-53e09209751d tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:52.775191 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-1eb3a17c-d7da-457c-9f94-53e09209751d tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63" status: 200 len: 1218 microversion: 2.1 time: 0.090553 Jun 03 09:59:52.775744 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 117/233] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:52 2022] GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:53.057213 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-3f9af6ec-1dd5-4965-862e-f921762572b1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:53.058410 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-3f9af6ec-1dd5-4965-862e-f921762572b1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:53.065403 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3f9af6ec-1dd5-4965-862e-f921762572b1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:53.065847 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3f9af6ec-1dd5-4965-862e-f921762572b1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:53.066687 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3f9af6ec-1dd5-4965-862e-f921762572b1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:53.067286 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3f9af6ec-1dd5-4965-862e-f921762572b1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:53.200355 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-3f9af6ec-1dd5-4965-862e-f921762572b1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:53.208118 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-3f9af6ec-1dd5-4965-862e-f921762572b1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 200 len: 1520 microversion: 2.1 time: 0.154693 Jun 03 09:59:53.208761 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 117/234] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:53 2022] GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:53.792767 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-5f0a6ac8-d3cc-4825-a301-91100a54390a tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:53.793374 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-5f0a6ac8-d3cc-4825-a301-91100a54390a tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 321fb69e-316f-4254-93dc-d30bd9128a63] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:53.799861 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5f0a6ac8-d3cc-4825-a301-91100a54390a tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:53.800314 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5f0a6ac8-d3cc-4825-a301-91100a54390a tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:53.801066 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5f0a6ac8-d3cc-4825-a301-91100a54390a tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:53.801503 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5f0a6ac8-d3cc-4825-a301-91100a54390a tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:53.865808 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-5f0a6ac8-d3cc-4825-a301-91100a54390a tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:53.874203 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-5f0a6ac8-d3cc-4825-a301-91100a54390a tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63" status: 200 len: 1266 microversion: 2.1 time: 0.085668 Jun 03 09:59:53.874857 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 118/235] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:53 2022] GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:54.224819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-4ae6dbbe-9e14-4dab-abb1-a6b87f75e568 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:54.225427 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-4ae6dbbe-9e14-4dab-abb1-a6b87f75e568 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:54.231942 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4ae6dbbe-9e14-4dab-abb1-a6b87f75e568 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:54.232334 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4ae6dbbe-9e14-4dab-abb1-a6b87f75e568 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:54.233112 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4ae6dbbe-9e14-4dab-abb1-a6b87f75e568 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:54.233527 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4ae6dbbe-9e14-4dab-abb1-a6b87f75e568 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:54.462317 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-4ae6dbbe-9e14-4dab-abb1-a6b87f75e568 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:54.469787 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-4ae6dbbe-9e14-4dab-abb1-a6b87f75e568 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 200 len: 1520 microversion: 2.1 time: 0.248751 Jun 03 09:59:54.470401 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 118/236] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:54 2022] GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:54.891939 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-2f0ab60b-3564-4c36-8d8d-a77ee2dea82d tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:54.892633 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-2f0ab60b-3564-4c36-8d8d-a77ee2dea82d tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 321fb69e-316f-4254-93dc-d30bd9128a63] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:54.899182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2f0ab60b-3564-4c36-8d8d-a77ee2dea82d tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:54.899551 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2f0ab60b-3564-4c36-8d8d-a77ee2dea82d tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:54.900308 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2f0ab60b-3564-4c36-8d8d-a77ee2dea82d tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:54.900736 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2f0ab60b-3564-4c36-8d8d-a77ee2dea82d tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:54.971377 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-2f0ab60b-3564-4c36-8d8d-a77ee2dea82d tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:54.978694 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-2f0ab60b-3564-4c36-8d8d-a77ee2dea82d tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63" status: 200 len: 1272 microversion: 2.1 time: 0.090962 Jun 03 09:59:54.979267 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 119/237] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:54 2022] GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63 => generated 1272 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:55.486577 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-13e8e920-8c63-4ab2-8991-654a3f941a6e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:55.487281 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-13e8e920-8c63-4ab2-8991-654a3f941a6e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:55.493909 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-13e8e920-8c63-4ab2-8991-654a3f941a6e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:55.494428 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-13e8e920-8c63-4ab2-8991-654a3f941a6e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:55.495263 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-13e8e920-8c63-4ab2-8991-654a3f941a6e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:55.495753 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-13e8e920-8c63-4ab2-8991-654a3f941a6e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:55.694449 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-13e8e920-8c63-4ab2-8991-654a3f941a6e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:55.702782 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-13e8e920-8c63-4ab2-8991-654a3f941a6e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 200 len: 1520 microversion: 2.1 time: 0.219998 Jun 03 09:59:55.703369 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 119/238] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:55 2022] GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:55.997548 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-d09b1578-b252-4b03-82b1-cbb1d143e007 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:55.998195 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-d09b1578-b252-4b03-82b1-cbb1d143e007 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 321fb69e-316f-4254-93dc-d30bd9128a63] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:56.005069 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d09b1578-b252-4b03-82b1-cbb1d143e007 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:56.005668 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d09b1578-b252-4b03-82b1-cbb1d143e007 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:56.007118 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d09b1578-b252-4b03-82b1-cbb1d143e007 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:56.007572 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d09b1578-b252-4b03-82b1-cbb1d143e007 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:56.164593 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-d09b1578-b252-4b03-82b1-cbb1d143e007 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:56.174160 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-d09b1578-b252-4b03-82b1-cbb1d143e007 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63" status: 200 len: 1314 microversion: 2.1 time: 0.181746 Jun 03 09:59:56.174921 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 120/239] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:55 2022] GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:56.223895 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-b88507cd-3179-47e1-967f-8f2ccffc579c req-95e34154-69a3-4f0d-84fd-83de19030b9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "321fb69e-316f-4254-93dc-d30bd9128a63", "tag": "04d9b6ae-6279-49c8-8187-3f7745f2a082"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:59:56.235937 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-b88507cd-3179-47e1-967f-8f2ccffc579c req-95e34154-69a3-4f0d-84fd-83de19030b9d service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:56.237081 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-b88507cd-3179-47e1-967f-8f2ccffc579c req-95e34154-69a3-4f0d-84fd-83de19030b9d service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:56.259949 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-b88507cd-3179-47e1-967f-8f2ccffc579c req-95e34154-69a3-4f0d-84fd-83de19030b9d service nova] Creating event network-changed:04d9b6ae-6279-49c8-8187-3f7745f2a082 for instance 321fb69e-316f-4254-93dc-d30bd9128a63 on hv-cinder-84456 Jun 03 09:59:56.265907 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-b88507cd-3179-47e1-967f-8f2ccffc579c req-95e34154-69a3-4f0d-84fd-83de19030b9d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045691 Jun 03 09:59:56.266868 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 120/240] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 09:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:59:56.727301 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-fda080c5-be73-4f82-9438-da8061b04830 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:56.736290 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-fda080c5-be73-4f82-9438-da8061b04830 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:56.737719 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fda080c5-be73-4f82-9438-da8061b04830 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:56.738244 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fda080c5-be73-4f82-9438-da8061b04830 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:56.739167 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fda080c5-be73-4f82-9438-da8061b04830 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:56.739612 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fda080c5-be73-4f82-9438-da8061b04830 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:56.958726 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-fda080c5-be73-4f82-9438-da8061b04830 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:56.966820 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-fda080c5-be73-4f82-9438-da8061b04830 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 200 len: 1520 microversion: 2.1 time: 0.248264 Jun 03 09:59:56.967392 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 121/241] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:56 2022] GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:57.191838 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-3a369c6b-c603-4636-bc3b-87e768e3ff5b tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:57.195768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-3a369c6b-c603-4636-bc3b-87e768e3ff5b tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 321fb69e-316f-4254-93dc-d30bd9128a63] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:57.199346 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3a369c6b-c603-4636-bc3b-87e768e3ff5b tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:57.199798 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3a369c6b-c603-4636-bc3b-87e768e3ff5b tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:57.200557 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3a369c6b-c603-4636-bc3b-87e768e3ff5b tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:57.200995 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3a369c6b-c603-4636-bc3b-87e768e3ff5b tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:57.300559 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-d996c3c2-b7f4-4470-b7c4-63fa1a827191 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:57.301198 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-d996c3c2-b7f4-4470-b7c4-63fa1a827191 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:57.307972 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d996c3c2-b7f4-4470-b7c4-63fa1a827191 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:57.308860 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d996c3c2-b7f4-4470-b7c4-63fa1a827191 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:57.309825 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d996c3c2-b7f4-4470-b7c4-63fa1a827191 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:57.310300 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d996c3c2-b7f4-4470-b7c4-63fa1a827191 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:57.334214 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-3a369c6b-c603-4636-bc3b-87e768e3ff5b tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:57.334383 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-d996c3c2-b7f4-4470-b7c4-63fa1a827191 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3/ips" status: 200 len: 147 microversion: 2.1 time: 0.038776 Jun 03 09:59:57.334978 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 122/242] 10.222.0.42 () {58 vars in 1247 bytes} [Fri Jun 3 09:59:57 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3/ips => generated 147 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:59:57.342135 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-3a369c6b-c603-4636-bc3b-87e768e3ff5b tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63" status: 200 len: 1314 microversion: 2.1 time: 0.154900 Jun 03 09:59:57.343207 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 121/243] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:57 2022] GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:57.983908 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-a74edc20-9e23-4e45-9c86-c094696ba8d1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:57.984615 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-a74edc20-9e23-4e45-9c86-c094696ba8d1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:57.990761 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a74edc20-9e23-4e45-9c86-c094696ba8d1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:57.991214 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a74edc20-9e23-4e45-9c86-c094696ba8d1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:57.999481 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a74edc20-9e23-4e45-9c86-c094696ba8d1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:57.999481 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a74edc20-9e23-4e45-9c86-c094696ba8d1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:58.147700 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-a74edc20-9e23-4e45-9c86-c094696ba8d1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:58.163482 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-a74edc20-9e23-4e45-9c86-c094696ba8d1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 200 len: 1520 microversion: 2.1 time: 0.183367 Jun 03 09:59:58.164083 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 123/244] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:57 2022] GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:58.358763 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-3f09f76e-e611-47f7-bf5b-152fdb9bd768 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:58.359291 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-3f09f76e-e611-47f7-bf5b-152fdb9bd768 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 321fb69e-316f-4254-93dc-d30bd9128a63] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:58.365722 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3f09f76e-e611-47f7-bf5b-152fdb9bd768 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:58.366193 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3f09f76e-e611-47f7-bf5b-152fdb9bd768 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:58.366935 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3f09f76e-e611-47f7-bf5b-152fdb9bd768 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:58.367360 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3f09f76e-e611-47f7-bf5b-152fdb9bd768 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:58.499518 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-3f09f76e-e611-47f7-bf5b-152fdb9bd768 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:58.506862 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-3f09f76e-e611-47f7-bf5b-152fdb9bd768 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63" status: 200 len: 1314 microversion: 2.1 time: 0.152025 Jun 03 09:59:58.507424 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 122/245] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:58 2022] GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:58.530139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-b142d0b0-ea18-4490-b331-365bfcfeef01 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:58.530678 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-b142d0b0-ea18-4490-b331-365bfcfeef01 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:58.536539 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b142d0b0-ea18-4490-b331-365bfcfeef01 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:58.536983 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b142d0b0-ea18-4490-b331-365bfcfeef01 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:58.537736 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b142d0b0-ea18-4490-b331-365bfcfeef01 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:58.538198 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b142d0b0-ea18-4490-b331-365bfcfeef01 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:58.561578 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-b142d0b0-ea18-4490-b331-365bfcfeef01 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46/ips" status: 200 len: 153 microversion: 2.20 time: 0.035295 Jun 03 09:59:58.562187 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 124/246] 10.222.0.42 () {60 vars in 1288 bytes} [Fri Jun 3 09:59:58 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46/ips => generated 153 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:59:59.180533 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-f32b28d2-d173-4147-bdf2-d9eba7d0a43d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:59.181137 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-f32b28d2-d173-4147-bdf2-d9eba7d0a43d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:59.188249 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f32b28d2-d173-4147-bdf2-d9eba7d0a43d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:59.188746 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f32b28d2-d173-4147-bdf2-d9eba7d0a43d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:59.189667 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f32b28d2-d173-4147-bdf2-d9eba7d0a43d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:59.190136 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f32b28d2-d173-4147-bdf2-d9eba7d0a43d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:59.322465 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f32b28d2-d173-4147-bdf2-d9eba7d0a43d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:59.330109 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-f32b28d2-d173-4147-bdf2-d9eba7d0a43d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 200 len: 1520 microversion: 2.1 time: 0.153481 Jun 03 09:59:59.330680 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 123/247] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:59 2022] GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:59.524626 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-4342f9f1-c8a3-427b-8295-d344cf4d8af5 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:59.525449 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-4342f9f1-c8a3-427b-8295-d344cf4d8af5 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 321fb69e-316f-4254-93dc-d30bd9128a63] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:59.532571 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4342f9f1-c8a3-427b-8295-d344cf4d8af5 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:59.533620 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4342f9f1-c8a3-427b-8295-d344cf4d8af5 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:59.534401 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4342f9f1-c8a3-427b-8295-d344cf4d8af5 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:59.534833 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4342f9f1-c8a3-427b-8295-d344cf4d8af5 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:59.681852 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-4342f9f1-c8a3-427b-8295-d344cf4d8af5 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:59.697579 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-4342f9f1-c8a3-427b-8295-d344cf4d8af5 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63" status: 200 len: 1314 microversion: 2.1 time: 0.170307 Jun 03 09:59:59.697579 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 125/248] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:59 2022] GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:00.347529 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-84efbccc-860a-46e7-9f68-b7d25f21e20c tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:00.348173 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-84efbccc-860a-46e7-9f68-b7d25f21e20c tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:00.357565 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-84efbccc-860a-46e7-9f68-b7d25f21e20c tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:00.358378 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-84efbccc-860a-46e7-9f68-b7d25f21e20c tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:00.359540 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-84efbccc-860a-46e7-9f68-b7d25f21e20c tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:00.360873 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-84efbccc-860a-46e7-9f68-b7d25f21e20c tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:00.541912 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-84efbccc-860a-46e7-9f68-b7d25f21e20c tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:00.549252 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-84efbccc-860a-46e7-9f68-b7d25f21e20c tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 200 len: 1520 microversion: 2.1 time: 0.206141 Jun 03 10:00:00.549827 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 124/249] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:00 2022] GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:00.709190 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-41fa00c7-b3c5-495c-8278-16dd53d00dc3 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:00.710408 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-41fa00c7-b3c5-495c-8278-16dd53d00dc3 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 321fb69e-316f-4254-93dc-d30bd9128a63] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:00.717663 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-41fa00c7-b3c5-495c-8278-16dd53d00dc3 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:00.718311 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-41fa00c7-b3c5-495c-8278-16dd53d00dc3 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:00.719069 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-41fa00c7-b3c5-495c-8278-16dd53d00dc3 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:00.719635 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-41fa00c7-b3c5-495c-8278-16dd53d00dc3 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:00.854360 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-41fa00c7-b3c5-495c-8278-16dd53d00dc3 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:00.865339 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-41fa00c7-b3c5-495c-8278-16dd53d00dc3 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63" status: 200 len: 1314 microversion: 2.1 time: 0.161501 Jun 03 10:00:00.866554 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 126/250] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:00 2022] GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:01.566410 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-7b669955-dd6d-4b1e-a4d3-311457c40f85 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:01.567118 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-7b669955-dd6d-4b1e-a4d3-311457c40f85 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:01.571078 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell0:SELECT=2 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:01.571952 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell0:SELECT=6 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:01.576050 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7b669955-dd6d-4b1e-a4d3-311457c40f85 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:01.576503 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7b669955-dd6d-4b1e-a4d3-311457c40f85 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:01.577794 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7b669955-dd6d-4b1e-a4d3-311457c40f85 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:01.578263 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7b669955-dd6d-4b1e-a4d3-311457c40f85 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:01.719743 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-7b669955-dd6d-4b1e-a4d3-311457c40f85 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:01.727283 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-7b669955-dd6d-4b1e-a4d3-311457c40f85 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 200 len: 1520 microversion: 2.1 time: 0.164950 Jun 03 10:00:01.727855 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 125/251] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:01 2022] GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:01.884266 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-af66b815-6cb9-4558-b8dc-0552c86340ff tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:01.884871 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-af66b815-6cb9-4558-b8dc-0552c86340ff tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 321fb69e-316f-4254-93dc-d30bd9128a63] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:01.887713 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell0:SELECT=2 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:01.892619 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-af66b815-6cb9-4558-b8dc-0552c86340ff tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:01.893059 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-af66b815-6cb9-4558-b8dc-0552c86340ff tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:01.893813 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-af66b815-6cb9-4558-b8dc-0552c86340ff tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:01.894300 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-af66b815-6cb9-4558-b8dc-0552c86340ff tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:02.032608 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-af66b815-6cb9-4558-b8dc-0552c86340ff tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:02.040534 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-af66b815-6cb9-4558-b8dc-0552c86340ff tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63" status: 200 len: 1314 microversion: 2.1 time: 0.160122 Jun 03 10:00:02.041112 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 127/252] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:01 2022] GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:02.745749 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-f5d286b0-c1a6-49ea-9a64-a5e3224b8c53 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:02.746395 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-f5d286b0-c1a6-49ea-9a64-a5e3224b8c53 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:02.754300 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f5d286b0-c1a6-49ea-9a64-a5e3224b8c53 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:02.754752 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f5d286b0-c1a6-49ea-9a64-a5e3224b8c53 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:02.755663 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f5d286b0-c1a6-49ea-9a64-a5e3224b8c53 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:02.756104 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f5d286b0-c1a6-49ea-9a64-a5e3224b8c53 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:02.893782 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f5d286b0-c1a6-49ea-9a64-a5e3224b8c53 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:02.902651 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-f5d286b0-c1a6-49ea-9a64-a5e3224b8c53 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 200 len: 1520 microversion: 2.1 time: 0.161669 Jun 03 10:00:02.903230 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 126/253] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:02 2022] GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:03.058057 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-109020d7-2385-44de-928f-603ff38069bd tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:03.058995 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-109020d7-2385-44de-928f-603ff38069bd tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 321fb69e-316f-4254-93dc-d30bd9128a63] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:03.065587 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-109020d7-2385-44de-928f-603ff38069bd tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:03.066064 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-109020d7-2385-44de-928f-603ff38069bd tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:03.066827 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-109020d7-2385-44de-928f-603ff38069bd tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:03.067264 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-109020d7-2385-44de-928f-603ff38069bd tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:03.135475 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-96277f76-6b01-4759-95bb-445acc324c00 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a306120d-3ddb-424d-b144-d9ee09affbbb"}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:03.137481 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-96277f76-6b01-4759-95bb-445acc324c00 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:03.147696 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-96277f76-6b01-4759-95bb-445acc324c00 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:03.148240 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-96277f76-6b01-4759-95bb-445acc324c00 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:03.149105 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-96277f76-6b01-4759-95bb-445acc324c00 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:03.149686 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-96277f76-6b01-4759-95bb-445acc324c00 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:03.247120 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-109020d7-2385-44de-928f-603ff38069bd tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:03.283688 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-109020d7-2385-44de-928f-603ff38069bd tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63" status: 200 len: 1314 microversion: 2.1 time: 0.229899 Jun 03 10:00:03.286547 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 128/254] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:03 2022] GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:03.763576 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-8b8ba2f5-b9cb-4cae-a20b-30ae9bbc656d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:03.764169 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-8b8ba2f5-b9cb-4cae-a20b-30ae9bbc656d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:03.770187 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8b8ba2f5-b9cb-4cae-a20b-30ae9bbc656d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:03.770641 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8b8ba2f5-b9cb-4cae-a20b-30ae9bbc656d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:03.771439 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8b8ba2f5-b9cb-4cae-a20b-30ae9bbc656d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:03.771872 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8b8ba2f5-b9cb-4cae-a20b-30ae9bbc656d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:03.796769 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.objects.instance [None req-8b8ba2f5-b9cb-4cae-a20b-30ae9bbc656d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lazy-loading 'flavor' on Instance uuid 6517823d-711a-4e24-9cdf-27812d522a46 {{(pid=125066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:00:04.559123 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-8b8ba2f5-b9cb-4cae-a20b-30ae9bbc656d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "POST /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46/action" status: 202 len: 0 microversion: 2.20 time: 0.800022 Jun 03 10:00:04.559798 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 129/255] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jun 3 10:00:03 2022] POST /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46/action => generated 0 bytes in 802 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 03 10:00:04.565049 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-0690d6ab-3de3-42ef-b051-aa268b01c303 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:04.565739 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-0690d6ab-3de3-42ef-b051-aa268b01c303 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:04.572705 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0690d6ab-3de3-42ef-b051-aa268b01c303 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:04.573191 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0690d6ab-3de3-42ef-b051-aa268b01c303 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:04.574060 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0690d6ab-3de3-42ef-b051-aa268b01c303 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:04.574545 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0690d6ab-3de3-42ef-b051-aa268b01c303 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:04.707984 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-0690d6ab-3de3-42ef-b051-aa268b01c303 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:04.716196 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-0690d6ab-3de3-42ef-b051-aa268b01c303 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 200 len: 1520 microversion: 2.1 time: 0.155170 Jun 03 10:00:04.726237 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 130/256] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:04 2022] GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:04.727989 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-96277f76-6b01-4759-95bb-445acc324c00 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "POST /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.598959 Jun 03 10:00:04.733723 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 127/257] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jun 3 10:00:03 2022] POST /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3/os-volume_attachments => generated 194 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:00:04.733868 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-19fe02ce-28df-49d3-8b0f-3c1de43738b5 req-cfc6fc97-be88-4080-8aa3-916d8ee011a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "321fb69e-316f-4254-93dc-d30bd9128a63", "name": "network-vif-plugged", "status": "completed", "tag": "04d9b6ae-6279-49c8-8187-3f7745f2a082"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:04.734627 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-012a2805-b23c-425c-bff8-011d33cfed9e tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:04.735514 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-012a2805-b23c-425c-bff8-011d33cfed9e tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 321fb69e-316f-4254-93dc-d30bd9128a63] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:04.738310 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-19fe02ce-28df-49d3-8b0f-3c1de43738b5 req-cfc6fc97-be88-4080-8aa3-916d8ee011a2 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:04.738828 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-19fe02ce-28df-49d3-8b0f-3c1de43738b5 req-cfc6fc97-be88-4080-8aa3-916d8ee011a2 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:04.741994 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-012a2805-b23c-425c-bff8-011d33cfed9e tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:04.742422 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-012a2805-b23c-425c-bff8-011d33cfed9e tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:04.743185 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-012a2805-b23c-425c-bff8-011d33cfed9e tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:04.743794 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-012a2805-b23c-425c-bff8-011d33cfed9e tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:04.751450 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-19fe02ce-28df-49d3-8b0f-3c1de43738b5 req-cfc6fc97-be88-4080-8aa3-916d8ee011a2 service nova] Creating event network-vif-plugged:04d9b6ae-6279-49c8-8187-3f7745f2a082 for instance 321fb69e-316f-4254-93dc-d30bd9128a63 on hv-cinder-84456 Jun 03 10:00:04.756466 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-19fe02ce-28df-49d3-8b0f-3c1de43738b5 req-cfc6fc97-be88-4080-8aa3-916d8ee011a2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031531 Jun 03 10:00:04.757088 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 131/258] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:00:04.762652 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-baabab8c-7260-4fa5-8f5b-f2d25d2d7787 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:04.763349 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-baabab8c-7260-4fa5-8f5b-f2d25d2d7787 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:04.769988 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-baabab8c-7260-4fa5-8f5b-f2d25d2d7787 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:04.770515 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-baabab8c-7260-4fa5-8f5b-f2d25d2d7787 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:04.771400 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-baabab8c-7260-4fa5-8f5b-f2d25d2d7787 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:04.771907 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-baabab8c-7260-4fa5-8f5b-f2d25d2d7787 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:04.956702 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-012a2805-b23c-425c-bff8-011d33cfed9e tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:04.971513 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-baabab8c-7260-4fa5-8f5b-f2d25d2d7787 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:04.976160 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-012a2805-b23c-425c-bff8-011d33cfed9e tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63" status: 200 len: 1314 microversion: 2.1 time: 0.245787 Jun 03 10:00:04.981304 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 128/259] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:04 2022] GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:04.981943 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-baabab8c-7260-4fa5-8f5b-f2d25d2d7787 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:04.983549 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-baabab8c-7260-4fa5-8f5b-f2d25d2d7787 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:04.986324 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-baabab8c-7260-4fa5-8f5b-f2d25d2d7787 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1724 microversion: 2.20 time: 0.227866 Jun 03 10:00:04.987133 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 132/260] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:04 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:05.733156 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-40d8467c-c1d3-43c4-a459-25d551d2871a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:05.733755 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-40d8467c-c1d3-43c4-a459-25d551d2871a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:05.740310 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-40d8467c-c1d3-43c4-a459-25d551d2871a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:05.740746 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-40d8467c-c1d3-43c4-a459-25d551d2871a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:05.741521 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-40d8467c-c1d3-43c4-a459-25d551d2871a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:05.741980 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-40d8467c-c1d3-43c4-a459-25d551d2871a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:05.889050 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-40d8467c-c1d3-43c4-a459-25d551d2871a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:05.896669 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-40d8467c-c1d3-43c4-a459-25d551d2871a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 200 len: 1520 microversion: 2.1 time: 0.167291 Jun 03 10:00:05.897294 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 129/261] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:05 2022] GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:05.997205 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-fa848559-8f46-463d-8543-74d4073cb1c4 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:05.997934 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-fa848559-8f46-463d-8543-74d4073cb1c4 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 321fb69e-316f-4254-93dc-d30bd9128a63] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:06.004085 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fa848559-8f46-463d-8543-74d4073cb1c4 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:06.004414 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-392053bb-5403-45b4-8813-cb2eabcbe759 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:06.004540 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fa848559-8f46-463d-8543-74d4073cb1c4 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:06.005164 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-392053bb-5403-45b4-8813-cb2eabcbe759 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:06.005262 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fa848559-8f46-463d-8543-74d4073cb1c4 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:06.005692 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fa848559-8f46-463d-8543-74d4073cb1c4 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:06.011317 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-392053bb-5403-45b4-8813-cb2eabcbe759 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:06.012024 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-392053bb-5403-45b4-8813-cb2eabcbe759 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:06.012771 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-392053bb-5403-45b4-8813-cb2eabcbe759 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:06.013198 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-392053bb-5403-45b4-8813-cb2eabcbe759 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:06.020979 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:06.192896 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-392053bb-5403-45b4-8813-cb2eabcbe759 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:06.201227 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-392053bb-5403-45b4-8813-cb2eabcbe759 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:06.203148 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-392053bb-5403-45b4-8813-cb2eabcbe759 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:06.203911 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-fa848559-8f46-463d-8543-74d4073cb1c4 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:06.204369 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-392053bb-5403-45b4-8813-cb2eabcbe759 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1724 microversion: 2.20 time: 0.203889 Jun 03 10:00:06.204930 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 130/262] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:05 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:00:06.211311 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-fa848559-8f46-463d-8543-74d4073cb1c4 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63" status: 200 len: 1314 microversion: 2.1 time: 0.218616 Jun 03 10:00:06.211863 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 133/263] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:05 2022] GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:06.914822 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-5d98b3f0-db80-4c57-891a-257f7cfc8db6 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:06.915423 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-5d98b3f0-db80-4c57-891a-257f7cfc8db6 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:06.923897 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5d98b3f0-db80-4c57-891a-257f7cfc8db6 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:06.923897 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5d98b3f0-db80-4c57-891a-257f7cfc8db6 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:06.924153 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5d98b3f0-db80-4c57-891a-257f7cfc8db6 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:06.924629 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5d98b3f0-db80-4c57-891a-257f7cfc8db6 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:06.941657 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:07.057637 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-5d98b3f0-db80-4c57-891a-257f7cfc8db6 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:07.065193 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-5d98b3f0-db80-4c57-891a-257f7cfc8db6 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 200 len: 1520 microversion: 2.1 time: 0.154216 Jun 03 10:00:07.065766 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 131/264] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:06 2022] GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:07.221966 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-9f7e5802-4342-4250-bda9-9b87b518e08b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:07.222651 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-9f7e5802-4342-4250-bda9-9b87b518e08b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:07.227906 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-ab9c3ab3-4280-423b-acbf-29c7cfa0c25c tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:07.228786 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-ab9c3ab3-4280-423b-acbf-29c7cfa0c25c tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 321fb69e-316f-4254-93dc-d30bd9128a63] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:07.230679 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9f7e5802-4342-4250-bda9-9b87b518e08b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:07.231555 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9f7e5802-4342-4250-bda9-9b87b518e08b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:07.232305 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9f7e5802-4342-4250-bda9-9b87b518e08b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:07.232952 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9f7e5802-4342-4250-bda9-9b87b518e08b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:07.236587 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ab9c3ab3-4280-423b-acbf-29c7cfa0c25c tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:07.237047 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ab9c3ab3-4280-423b-acbf-29c7cfa0c25c tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:07.237815 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ab9c3ab3-4280-423b-acbf-29c7cfa0c25c tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:07.238281 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ab9c3ab3-4280-423b-acbf-29c7cfa0c25c tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:07.428231 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-9f7e5802-4342-4250-bda9-9b87b518e08b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:07.438249 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-9f7e5802-4342-4250-bda9-9b87b518e08b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:07.442802 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-ab9c3ab3-4280-423b-acbf-29c7cfa0c25c tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:07.449371 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-9f7e5802-4342-4250-bda9-9b87b518e08b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:07.450951 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-9f7e5802-4342-4250-bda9-9b87b518e08b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1724 microversion: 2.20 time: 0.232966 Jun 03 10:00:07.451525 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 134/265] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:07 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:07.451876 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-ab9c3ab3-4280-423b-acbf-29c7cfa0c25c tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63" status: 200 len: 1498 microversion: 2.1 time: 0.227762 Jun 03 10:00:07.463695 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 132/266] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:07 2022] GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63 => generated 1498 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:08.084033 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-bdcf6d56-ad07-460f-af99-c44d17b3ee31 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:08.084933 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-bdcf6d56-ad07-460f-af99-c44d17b3ee31 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:08.093679 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bdcf6d56-ad07-460f-af99-c44d17b3ee31 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:08.094162 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bdcf6d56-ad07-460f-af99-c44d17b3ee31 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:08.098106 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bdcf6d56-ad07-460f-af99-c44d17b3ee31 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:08.098106 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bdcf6d56-ad07-460f-af99-c44d17b3ee31 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:08.242941 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-bdcf6d56-ad07-460f-af99-c44d17b3ee31 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:08.257222 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-bdcf6d56-ad07-460f-af99-c44d17b3ee31 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 200 len: 1520 microversion: 2.1 time: 0.179652 Jun 03 10:00:08.257818 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 135/267] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:08 2022] GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:08.468817 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-4354fbcf-8e25-46c2-ac65-8a9178abce60 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:08.469941 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-4354fbcf-8e25-46c2-ac65-8a9178abce60 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:08.478027 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4354fbcf-8e25-46c2-ac65-8a9178abce60 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:08.478470 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4354fbcf-8e25-46c2-ac65-8a9178abce60 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:08.479760 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4354fbcf-8e25-46c2-ac65-8a9178abce60 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:08.480186 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4354fbcf-8e25-46c2-ac65-8a9178abce60 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:08.481368 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-2b049a49-655f-4a3b-9e0e-a6e646afb16e tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:08.482152 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-2b049a49-655f-4a3b-9e0e-a6e646afb16e tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 321fb69e-316f-4254-93dc-d30bd9128a63] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:08.489244 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2b049a49-655f-4a3b-9e0e-a6e646afb16e tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:08.490274 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2b049a49-655f-4a3b-9e0e-a6e646afb16e tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:08.491120 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2b049a49-655f-4a3b-9e0e-a6e646afb16e tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:08.491776 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2b049a49-655f-4a3b-9e0e-a6e646afb16e tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:08.520392 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-2b049a49-655f-4a3b-9e0e-a6e646afb16e tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 321fb69e-316f-4254-93dc-d30bd9128a63] Going to try to terminate instance {{(pid=125066) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:00:08.843029 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-2b049a49-655f-4a3b-9e0e-a6e646afb16e tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "DELETE /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63" status: 204 len: 0 microversion: 2.1 time: 0.367501 Jun 03 10:00:08.843625 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 136/268] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 3 10:00:08 2022] DELETE /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 03 10:00:08.852018 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-e9021b15-68cc-4432-a97e-8610cd4ca609 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:08.852390 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-4354fbcf-8e25-46c2-ac65-8a9178abce60 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:08.855701 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-e9021b15-68cc-4432-a97e-8610cd4ca609 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 321fb69e-316f-4254-93dc-d30bd9128a63] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:08.859420 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e9021b15-68cc-4432-a97e-8610cd4ca609 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:08.859863 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e9021b15-68cc-4432-a97e-8610cd4ca609 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:08.860621 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e9021b15-68cc-4432-a97e-8610cd4ca609 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:08.861022 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-4354fbcf-8e25-46c2-ac65-8a9178abce60 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:08.861145 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e9021b15-68cc-4432-a97e-8610cd4ca609 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:08.862614 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-4354fbcf-8e25-46c2-ac65-8a9178abce60 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:08.863764 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-4354fbcf-8e25-46c2-ac65-8a9178abce60 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1724 microversion: 2.20 time: 0.398920 Jun 03 10:00:08.864331 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 133/269] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:08 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1724 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:08.994500 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-e9021b15-68cc-4432-a97e-8610cd4ca609 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:09.002089 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-e9021b15-68cc-4432-a97e-8610cd4ca609 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63" status: 200 len: 1504 microversion: 2.1 time: 0.154143 Jun 03 10:00:09.002659 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 137/270] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:08 2022] GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:09.273835 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-53ad2190-7c45-4594-9023-75a2cd7600af tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:09.274470 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-53ad2190-7c45-4594-9023-75a2cd7600af tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:09.281419 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-53ad2190-7c45-4594-9023-75a2cd7600af tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:09.282124 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-53ad2190-7c45-4594-9023-75a2cd7600af tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:09.282993 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-53ad2190-7c45-4594-9023-75a2cd7600af tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:09.283571 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-53ad2190-7c45-4594-9023-75a2cd7600af tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:09.435670 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-53ad2190-7c45-4594-9023-75a2cd7600af tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:09.445027 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-53ad2190-7c45-4594-9023-75a2cd7600af tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 200 len: 1520 microversion: 2.1 time: 0.174850 Jun 03 10:00:09.445924 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 134/271] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:09 2022] GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:09.881867 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-2feff886-fab6-4085-ab35-bb6d2f8fc55d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:09.885836 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-2feff886-fab6-4085-ab35-bb6d2f8fc55d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:09.889569 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2feff886-fab6-4085-ab35-bb6d2f8fc55d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:09.890092 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2feff886-fab6-4085-ab35-bb6d2f8fc55d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:09.890896 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2feff886-fab6-4085-ab35-bb6d2f8fc55d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:09.891376 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2feff886-fab6-4085-ab35-bb6d2f8fc55d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:10.019065 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-ea726545-11f1-4ebe-983f-0fbe89918780 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:10.019666 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-ea726545-11f1-4ebe-983f-0fbe89918780 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 321fb69e-316f-4254-93dc-d30bd9128a63] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:10.026718 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ea726545-11f1-4ebe-983f-0fbe89918780 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:10.027165 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ea726545-11f1-4ebe-983f-0fbe89918780 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:10.027981 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ea726545-11f1-4ebe-983f-0fbe89918780 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:10.028501 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ea726545-11f1-4ebe-983f-0fbe89918780 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:10.030276 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-2feff886-fab6-4085-ab35-bb6d2f8fc55d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:10.038974 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-2feff886-fab6-4085-ab35-bb6d2f8fc55d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:10.040564 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-2feff886-fab6-4085-ab35-bb6d2f8fc55d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:10.042512 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-2feff886-fab6-4085-ab35-bb6d2f8fc55d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1724 microversion: 2.20 time: 0.163940 Jun 03 10:00:10.043079 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 138/272] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:09 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:10.169515 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-ea726545-11f1-4ebe-983f-0fbe89918780 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:10.177180 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-ea726545-11f1-4ebe-983f-0fbe89918780 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63" status: 200 len: 1504 microversion: 2.1 time: 0.162015 Jun 03 10:00:10.177766 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 135/273] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:10 2022] GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:10.462144 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-8bb80755-a522-4a57-826f-e4765a07112c tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:10.462877 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-8bb80755-a522-4a57-826f-e4765a07112c tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:10.470963 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8bb80755-a522-4a57-826f-e4765a07112c tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:10.471425 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8bb80755-a522-4a57-826f-e4765a07112c tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:10.472557 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8bb80755-a522-4a57-826f-e4765a07112c tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:10.475383 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8bb80755-a522-4a57-826f-e4765a07112c tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:10.611628 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-8bb80755-a522-4a57-826f-e4765a07112c tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:10.622196 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-8bb80755-a522-4a57-826f-e4765a07112c tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 200 len: 1520 microversion: 2.1 time: 0.163841 Jun 03 10:00:10.622784 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 139/274] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:10 2022] GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:11.060795 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-64914881-72b6-40d4-8106-5e07a54bce2b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:11.061991 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-64914881-72b6-40d4-8106-5e07a54bce2b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:11.068220 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-64914881-72b6-40d4-8106-5e07a54bce2b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:11.068661 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-64914881-72b6-40d4-8106-5e07a54bce2b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:11.071857 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-64914881-72b6-40d4-8106-5e07a54bce2b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:11.071857 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-64914881-72b6-40d4-8106-5e07a54bce2b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:11.193511 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-b92e8519-a4ac-4710-ba54-aa05f4f72211 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:11.194198 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-b92e8519-a4ac-4710-ba54-aa05f4f72211 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 321fb69e-316f-4254-93dc-d30bd9128a63] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:11.201168 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b92e8519-a4ac-4710-ba54-aa05f4f72211 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:11.201626 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b92e8519-a4ac-4710-ba54-aa05f4f72211 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:11.202422 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b92e8519-a4ac-4710-ba54-aa05f4f72211 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:11.203078 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b92e8519-a4ac-4710-ba54-aa05f4f72211 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:11.227961 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-64914881-72b6-40d4-8106-5e07a54bce2b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:11.243021 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-64914881-72b6-40d4-8106-5e07a54bce2b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:11.252734 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-64914881-72b6-40d4-8106-5e07a54bce2b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:11.252734 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-64914881-72b6-40d4-8106-5e07a54bce2b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1724 microversion: 2.20 time: 0.194293 Jun 03 10:00:11.252734 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 136/275] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:11 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:11.353892 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-b92e8519-a4ac-4710-ba54-aa05f4f72211 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:11.361515 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-b92e8519-a4ac-4710-ba54-aa05f4f72211 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63" status: 200 len: 1504 microversion: 2.1 time: 0.171914 Jun 03 10:00:11.362124 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 140/276] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:11 2022] GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63 => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:11.640044 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-5796683b-3c8a-4cce-8c93-4b6b155a03f9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:11.640566 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-5796683b-3c8a-4cce-8c93-4b6b155a03f9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:11.647084 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5796683b-3c8a-4cce-8c93-4b6b155a03f9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:11.647541 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5796683b-3c8a-4cce-8c93-4b6b155a03f9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:11.648404 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5796683b-3c8a-4cce-8c93-4b6b155a03f9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:11.648850 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5796683b-3c8a-4cce-8c93-4b6b155a03f9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:11.801239 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-5796683b-3c8a-4cce-8c93-4b6b155a03f9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:11.809533 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-5796683b-3c8a-4cce-8c93-4b6b155a03f9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 200 len: 1500 microversion: 2.1 time: 0.174478 Jun 03 10:00:11.810125 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 137/277] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:11 2022] GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 1500 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:11.834118 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-207b22c0-f118-4d42-a58e-e9f5a06dc30f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d98e37ea-275f-4310-a6b1-0570905fbadb"}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:11.835293 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-207b22c0-f118-4d42-a58e-e9f5a06dc30f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:11.845306 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-207b22c0-f118-4d42-a58e-e9f5a06dc30f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:11.845757 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-207b22c0-f118-4d42-a58e-e9f5a06dc30f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:11.846567 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-207b22c0-f118-4d42-a58e-e9f5a06dc30f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:11.847005 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-207b22c0-f118-4d42-a58e-e9f5a06dc30f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:11.883624 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.wsgi [None req-207b22c0-f118-4d42-a58e-e9f5a06dc30f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] HTTP exception thrown: Cannot 'attach_volume' instance 28ff128f-ff5e-4889-9f83-bdfb4b86a83d while it is in vm_state rescued Jun 03 10:00:11.888453 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-207b22c0-f118-4d42-a58e-e9f5a06dc30f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Request method failure captured: Jun 03 10:00:11.888453 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: request: POST /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d/os-volume_attachments HTTP/1.1 Jun 03 10:00:11.888453 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept: application/json Jun 03 10:00:11.888453 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept-Encoding: identity Jun 03 10:00:11.888453 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Connection: close Jun 03 10:00:11.888453 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Length: 74 Jun 03 10:00:11.888453 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Type: application/json Jun 03 10:00:11.888453 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Host: 10.222.0.42 Jun 03 10:00:11.888453 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Openstack-System-Scope: None Jun 03 10:00:11.888453 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: User-Agent: python-urllib3/1.26.9 Jun 03 10:00:11.888453 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Auth-Token: gAAAAABimds_lF-taAYQo6OqoH0o0qi_k4NNuMaAcWJ32OQUNw2FlKeLvYNXSQEH9BN_rrTQvUY_gre2GoIt-GajpX5LOw35Rcbqj_XeR_tQGE2UjgXtf1IV-n56Dfe8ZzhxcJSCI1WvNiH6DeAg_ruh1xJPuTtCWLGR6KAI-13SXw4-Q7nABOE Jun 03 10:00:11.888453 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Id: None Jun 03 10:00:11.888453 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Name: None Jun 03 10:00:11.888453 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Identity-Status: Confirmed Jun 03 10:00:11.888453 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Is-Admin-Project: True Jun 03 10:00:11.888453 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Id: default Jun 03 10:00:11.888453 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Name: Default Jun 03 10:00:11.888453 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Id: 071b399988474af1a1c709aac97c1744 Jun 03 10:00:11.888453 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1884263324 Jun 03 10:00:11.888453 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Role: member,reader Jun 03 10:00:11.888453 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Roles: member,reader Jun 03 10:00:11.889960 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/071b399988474af1a1c709aac97c1744"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/071b399988474af1a1c709aac97c1744"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_071b399988474af1a1c709aac97c1744", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/071b399988474af1a1c709aac97c1744"}]}] Jun 03 10:00:11.889960 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1884263324 Jun 03 10:00:11.889960 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Id: 071b399988474af1a1c709aac97c1744 Jun 03 10:00:11.889960 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1884263324 Jun 03 10:00:11.889960 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User: tempest-ServerRescueNegativeTestJSON-1884263324-project Jun 03 10:00:11.889960 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Id: default Jun 03 10:00:11.889960 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Name: Default Jun 03 10:00:11.889960 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Id: 6113d715500240098217caf641db763a Jun 03 10:00:11.889960 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1884263324-project Jun 03 10:00:11.889960 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Jun 03 10:00:11.889960 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {"volumeAttachment": {"volumeId": "d98e37ea-275f-4310-a6b1-0570905fbadb"}} Jun 03 10:00:11.889960 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: method: > Jun 03 10:00:11.890835 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: exception: Cannot 'attach_volume' instance 28ff128f-ff5e-4889-9f83-bdfb4b86a83d while it is in vm_state rescued Jun 03 10:00:11.890835 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: action_args: {'server_id': '28ff128f-ff5e-4889-9f83-bdfb4b86a83d', 'body': {'volumeAttachment': {'volumeId': 'd98e37ea-275f-4310-a6b1-0570905fbadb'}}} Jun 03 10:00:11.890835 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:00:11.890835 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:00:11.890835 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 03 10:00:11.890835 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 03 10:00:11.890835 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 03 10:00:11.890835 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 03 10:00:11.890835 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 03 10:00:11.890835 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 03 10:00:11.890835 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 28ff128f-ff5e-4889-9f83-bdfb4b86a83d in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 03 10:00:11.890835 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:00:11.890835 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:00:11.890835 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:00:11.890835 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:00:11.890835 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:00:11.890835 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:00:11.890835 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:00:11.890835 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:00:11.891882 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:00:11.891882 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:00:11.891882 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 10:00:11.891882 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 10:00:11.891882 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 10:00:11.891882 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 10:00:11.891882 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 10:00:11.891882 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 10:00:11.891882 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 03 10:00:11.891882 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 03 10:00:11.891882 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 03 10:00:11.891882 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 03 10:00:11.891882 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 28ff128f-ff5e-4889-9f83-bdfb4b86a83d while it is in vm_state rescued Jun 03 10:00:11.891882 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:00:11.891882 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:00:11.891882 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:00:11.891882 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:00:11.891882 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:00:11.891882 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:00:11.892871 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:00:11.892871 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:00:11.892871 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 28ff128f-ff5e-4889-9f83-bdfb4b86a83d while it is in vm_state rescued Jun 03 10:00:11.892871 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:00:11.892871 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-207b22c0-f118-4d42-a58e-e9f5a06dc30f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Returning 409 to user: Cannot 'attach_volume' instance 28ff128f-ff5e-4889-9f83-bdfb4b86a83d while it is in vm_state rescued {{(pid=125066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:00:11.892871 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-207b22c0-f118-4d42-a58e-e9f5a06dc30f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "POST /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.066199 Jun 03 10:00:11.892871 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 141/278] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jun 3 10:00:11 2022] POST /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d/os-volume_attachments => generated 152 bytes in 68 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 03 10:00:11.899277 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-b7c35b1d-934d-4a68-b1ec-1b72f5703bc1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:11.900029 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-b7c35b1d-934d-4a68-b1ec-1b72f5703bc1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:11.906242 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b7c35b1d-934d-4a68-b1ec-1b72f5703bc1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:11.906701 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b7c35b1d-934d-4a68-b1ec-1b72f5703bc1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:11.907486 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b7c35b1d-934d-4a68-b1ec-1b72f5703bc1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:11.907937 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b7c35b1d-934d-4a68-b1ec-1b72f5703bc1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:12.126205 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-b7c35b1d-934d-4a68-b1ec-1b72f5703bc1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "POST /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d/action" status: 202 len: 0 microversion: 2.1 time: 0.230623 Jun 03 10:00:12.140970 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-ab13b2ad-f2c2-4fe5-be48-8d0ce81262ba tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:12.141522 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-ab13b2ad-f2c2-4fe5-be48-8d0ce81262ba tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:12.144598 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 138/279] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jun 3 10:00:11 2022] POST /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:00:12.147843 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ab13b2ad-f2c2-4fe5-be48-8d0ce81262ba tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:12.148421 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ab13b2ad-f2c2-4fe5-be48-8d0ce81262ba tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:12.149176 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ab13b2ad-f2c2-4fe5-be48-8d0ce81262ba tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:12.149606 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ab13b2ad-f2c2-4fe5-be48-8d0ce81262ba tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:12.272783 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-5d3d4959-bbd6-4013-9ccc-87ffc7d37afd tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:12.273508 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-5d3d4959-bbd6-4013-9ccc-87ffc7d37afd tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:12.280536 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5d3d4959-bbd6-4013-9ccc-87ffc7d37afd tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:12.280989 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5d3d4959-bbd6-4013-9ccc-87ffc7d37afd tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:12.281750 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5d3d4959-bbd6-4013-9ccc-87ffc7d37afd tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:12.282204 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5d3d4959-bbd6-4013-9ccc-87ffc7d37afd tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:12.422284 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-ab13b2ad-f2c2-4fe5-be48-8d0ce81262ba tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:12.430270 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-ab13b2ad-f2c2-4fe5-be48-8d0ce81262ba tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 200 len: 1508 microversion: 2.1 time: 0.298798 Jun 03 10:00:12.430916 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 142/280] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:12 2022] GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 1508 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:12.446500 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-7b2ae660-c309-4bfc-a57d-a299a5f458e0 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:12.447449 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-7b2ae660-c309-4bfc-a57d-a299a5f458e0 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 321fb69e-316f-4254-93dc-d30bd9128a63] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:12.455014 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7b2ae660-c309-4bfc-a57d-a299a5f458e0 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:12.460131 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7b2ae660-c309-4bfc-a57d-a299a5f458e0 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:12.461627 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7b2ae660-c309-4bfc-a57d-a299a5f458e0 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:12.462312 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7b2ae660-c309-4bfc-a57d-a299a5f458e0 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:12.576079 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-7b2ae660-c309-4bfc-a57d-a299a5f458e0 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:12.584397 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-7b2ae660-c309-4bfc-a57d-a299a5f458e0 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63" status: 200 len: 1462 microversion: 2.1 time: 0.142222 Jun 03 10:00:12.588134 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 143/281] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:12 2022] GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63 => generated 1462 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:12.588246 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-5d3d4959-bbd6-4013-9ccc-87ffc7d37afd tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:12.590878 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-c930f6c5-56de-41f2-8072-183ca5359173 req-a9e6bc44-8d0f-491a-8c9e-1026ab117900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "321fb69e-316f-4254-93dc-d30bd9128a63", "name": "network-vif-deleted", "tag": "04d9b6ae-6279-49c8-8187-3f7745f2a082"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:12.597229 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-5d3d4959-bbd6-4013-9ccc-87ffc7d37afd tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:12.598749 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-c930f6c5-56de-41f2-8072-183ca5359173 req-a9e6bc44-8d0f-491a-8c9e-1026ab117900 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:12.599194 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-c930f6c5-56de-41f2-8072-183ca5359173 req-a9e6bc44-8d0f-491a-8c9e-1026ab117900 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:12.599326 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-5d3d4959-bbd6-4013-9ccc-87ffc7d37afd tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:12.600744 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-5d3d4959-bbd6-4013-9ccc-87ffc7d37afd tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1724 microversion: 2.20 time: 0.332302 Jun 03 10:00:12.601379 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 139/282] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:12 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1724 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:12.612338 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-c930f6c5-56de-41f2-8072-183ca5359173 req-a9e6bc44-8d0f-491a-8c9e-1026ab117900 service nova] Creating event network-vif-deleted:04d9b6ae-6279-49c8-8187-3f7745f2a082 for instance 321fb69e-316f-4254-93dc-d30bd9128a63 on hv-cinder-84456 Jun 03 10:00:12.617233 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-c930f6c5-56de-41f2-8072-183ca5359173 req-a9e6bc44-8d0f-491a-8c9e-1026ab117900 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031146 Jun 03 10:00:12.617846 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 144/283] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:00:13.380257 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-3318fa61-1973-4af4-9a31-8e982c10f02e tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:13.388368 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3318fa61-1973-4af4-9a31-8e982c10f02e tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:13.389189 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3318fa61-1973-4af4-9a31-8e982c10f02e tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:13.449033 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-464b4c1b-e015-4091-8709-0d911559f944 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:13.449822 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-464b4c1b-e015-4091-8709-0d911559f944 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:13.453172 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-3318fa61-1973-4af4-9a31-8e982c10f02e tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Going to try to stop instance {{(pid=125065) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 03 10:00:13.456277 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-464b4c1b-e015-4091-8709-0d911559f944 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:13.456744 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-464b4c1b-e015-4091-8709-0d911559f944 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:13.457509 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-464b4c1b-e015-4091-8709-0d911559f944 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:13.458146 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-464b4c1b-e015-4091-8709-0d911559f944 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:13.598732 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-464b4c1b-e015-4091-8709-0d911559f944 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:13.607397 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-464b4c1b-e015-4091-8709-0d911559f944 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 200 len: 1508 microversion: 2.1 time: 0.162933 Jun 03 10:00:13.607972 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 145/284] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:13 2022] GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:13.612512 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-140758f0-40e0-4e1c-b206-d63467d3ea29 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:13.613145 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-140758f0-40e0-4e1c-b206-d63467d3ea29 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 321fb69e-316f-4254-93dc-d30bd9128a63] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:13.621221 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-140758f0-40e0-4e1c-b206-d63467d3ea29 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:13.621697 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-140758f0-40e0-4e1c-b206-d63467d3ea29 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:13.622540 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-140758f0-40e0-4e1c-b206-d63467d3ea29 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:13.623143 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-140758f0-40e0-4e1c-b206-d63467d3ea29 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:13.661724 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-140758f0-40e0-4e1c-b206-d63467d3ea29 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:13.662218 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-140758f0-40e0-4e1c-b206-d63467d3ea29 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:13.662787 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.objects.instance [None req-140758f0-40e0-4e1c-b206-d63467d3ea29 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lazy-loading 'fault' on Instance uuid 321fb69e-316f-4254-93dc-d30bd9128a63 {{(pid=125066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:00:13.685003 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-3318fa61-1973-4af4-9a31-8e982c10f02e tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "POST /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3/action" status: 202 len: 0 microversion: 2.1 time: 0.309192 Jun 03 10:00:13.685609 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 140/285] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jun 3 10:00:13 2022] POST /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:00:13.691802 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-42897628-cb65-4b52-a182-d32e7fb7aef0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:13.693332 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-42897628-cb65-4b52-a182-d32e7fb7aef0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:13.699879 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-42897628-cb65-4b52-a182-d32e7fb7aef0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:13.700344 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-42897628-cb65-4b52-a182-d32e7fb7aef0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:13.701089 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-42897628-cb65-4b52-a182-d32e7fb7aef0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:13.701518 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-42897628-cb65-4b52-a182-d32e7fb7aef0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:13.711631 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-140758f0-40e0-4e1c-b206-d63467d3ea29 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:13.721219 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-140758f0-40e0-4e1c-b206-d63467d3ea29 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63" status: 200 len: 1304 microversion: 2.1 time: 0.112177 Jun 03 10:00:13.731208 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 146/286] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:13 2022] GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63 => generated 1304 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:13.731208 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-5b61e8a9-7123-4387-87e8-918a1d1f8dfc tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:13.731208 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-5b61e8a9-7123-4387-87e8-918a1d1f8dfc tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:13.736367 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5b61e8a9-7123-4387-87e8-918a1d1f8dfc tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:13.736841 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5b61e8a9-7123-4387-87e8-918a1d1f8dfc tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:13.737576 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5b61e8a9-7123-4387-87e8-918a1d1f8dfc tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:13.741741 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5b61e8a9-7123-4387-87e8-918a1d1f8dfc tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:13.921092 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-42897628-cb65-4b52-a182-d32e7fb7aef0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:13.925171 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-5b61e8a9-7123-4387-87e8-918a1d1f8dfc tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:13.929926 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-42897628-cb65-4b52-a182-d32e7fb7aef0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:13.931634 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-42897628-cb65-4b52-a182-d32e7fb7aef0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:13.933332 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-42897628-cb65-4b52-a182-d32e7fb7aef0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1724 microversion: 2.20 time: 0.246384 Jun 03 10:00:13.933910 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-5b61e8a9-7123-4387-87e8-918a1d1f8dfc tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1726 microversion: 2.1 time: 0.209097 Jun 03 10:00:13.934010 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 141/287] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:13 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:13.937945 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 147/288] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:13 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1726 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:14.624940 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-c9fe754d-9e7c-45c4-a1f3-3aa9ea367494 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:14.626360 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-c9fe754d-9e7c-45c4-a1f3-3aa9ea367494 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:14.633582 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c9fe754d-9e7c-45c4-a1f3-3aa9ea367494 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:14.634325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c9fe754d-9e7c-45c4-a1f3-3aa9ea367494 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:14.635949 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c9fe754d-9e7c-45c4-a1f3-3aa9ea367494 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:14.636407 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c9fe754d-9e7c-45c4-a1f3-3aa9ea367494 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:14.743783 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-c6c85182-ee69-4e04-8cc9-b5b381a02e30 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:14.744393 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-c6c85182-ee69-4e04-8cc9-b5b381a02e30 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 321fb69e-316f-4254-93dc-d30bd9128a63] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:14.750425 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:14.752086 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c6c85182-ee69-4e04-8cc9-b5b381a02e30 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:14.752757 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c6c85182-ee69-4e04-8cc9-b5b381a02e30 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:14.753522 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c6c85182-ee69-4e04-8cc9-b5b381a02e30 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:14.753980 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c6c85182-ee69-4e04-8cc9-b5b381a02e30 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:14.794596 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c6c85182-ee69-4e04-8cc9-b5b381a02e30 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:14.795050 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c6c85182-ee69-4e04-8cc9-b5b381a02e30 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:14.795499 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.objects.instance [None req-c6c85182-ee69-4e04-8cc9-b5b381a02e30 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lazy-loading 'fault' on Instance uuid 321fb69e-316f-4254-93dc-d30bd9128a63 {{(pid=125066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:00:14.832402 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-c9fe754d-9e7c-45c4-a1f3-3aa9ea367494 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:14.840967 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-c9fe754d-9e7c-45c4-a1f3-3aa9ea367494 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 200 len: 1508 microversion: 2.1 time: 0.220089 Jun 03 10:00:14.841559 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 142/289] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:14 2022] GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 1508 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:14.848038 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-c6c85182-ee69-4e04-8cc9-b5b381a02e30 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dd300436c9545faa56d60ac290bc987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1793ba5f584cb0a9005c50d80c5c06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:14.850765 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:14.856797 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-c6c85182-ee69-4e04-8cc9-b5b381a02e30 tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63" status: 200 len: 1304 microversion: 2.1 time: 0.118483 Jun 03 10:00:14.857361 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 148/290] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:14 2022] GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63 => generated 1304 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:14.955741 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-42fdcc6e-a61b-4585-864a-47566f5a1085 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:14.955741 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-42fdcc6e-a61b-4585-864a-47566f5a1085 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:14.961510 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-bbf215da-6d23-44cc-a730-e8be061cdfd8 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:14.968356 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-bbf215da-6d23-44cc-a730-e8be061cdfd8 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:14.970068 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-bbf215da-6d23-44cc-a730-e8be061cdfd8 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:14.970673 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-bbf215da-6d23-44cc-a730-e8be061cdfd8 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:14.971541 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-42fdcc6e-a61b-4585-864a-47566f5a1085 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:14.971879 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-bbf215da-6d23-44cc-a730-e8be061cdfd8 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:14.972125 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-42fdcc6e-a61b-4585-864a-47566f5a1085 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:14.972616 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-bbf215da-6d23-44cc-a730-e8be061cdfd8 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:14.973182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-42fdcc6e-a61b-4585-864a-47566f5a1085 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:14.973733 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-42fdcc6e-a61b-4585-864a-47566f5a1085 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:15.297736 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-42fdcc6e-a61b-4585-864a-47566f5a1085 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:15.310071 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-42fdcc6e-a61b-4585-864a-47566f5a1085 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1726 microversion: 2.1 time: 0.360017 Jun 03 10:00:15.310886 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 149/291] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:14 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1726 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:15.312524 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-bbf215da-6d23-44cc-a730-e8be061cdfd8 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:15.327682 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-bbf215da-6d23-44cc-a730-e8be061cdfd8 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:15.327682 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-bbf215da-6d23-44cc-a730-e8be061cdfd8 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:15.327682 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-bbf215da-6d23-44cc-a730-e8be061cdfd8 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1724 microversion: 2.20 time: 0.378198 Jun 03 10:00:15.327928 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 143/292] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:14 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1724 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:15.860084 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-bf569369-340e-48ee-9b82-73f553c821ad tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:15.861376 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-bf569369-340e-48ee-9b82-73f553c821ad tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:15.867987 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bf569369-340e-48ee-9b82-73f553c821ad tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:15.874357 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-22359359-2d21-4703-9425-cc178a43da1c tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:15.875723 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-22359359-2d21-4703-9425-cc178a43da1c tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] [instance: 321fb69e-316f-4254-93dc-d30bd9128a63] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:15.879404 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bf569369-340e-48ee-9b82-73f553c821ad tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:15.882207 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bf569369-340e-48ee-9b82-73f553c821ad tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:15.882818 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bf569369-340e-48ee-9b82-73f553c821ad tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:15.883576 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-22359359-2d21-4703-9425-cc178a43da1c tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:15.884027 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-22359359-2d21-4703-9425-cc178a43da1c tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:15.884802 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-22359359-2d21-4703-9425-cc178a43da1c tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:15.885286 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-22359359-2d21-4703-9425-cc178a43da1c tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:15.900592 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.wsgi [None req-22359359-2d21-4703-9425-cc178a43da1c tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] HTTP exception thrown: Instance 321fb69e-316f-4254-93dc-d30bd9128a63 could not be found. Jun 03 10:00:15.902679 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-22359359-2d21-4703-9425-cc178a43da1c tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Request method failure captured: Jun 03 10:00:15.902679 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: request: GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63 HTTP/1.1 Jun 03 10:00:15.902679 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept: application/json Jun 03 10:00:15.902679 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept-Encoding: identity Jun 03 10:00:15.902679 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Connection: close Jun 03 10:00:15.902679 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Length: 0 Jun 03 10:00:15.902679 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Type: application/json Jun 03 10:00:15.902679 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Host: 10.222.0.42 Jun 03 10:00:15.902679 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Openstack-System-Scope: None Jun 03 10:00:15.902679 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: User-Agent: python-urllib3/1.26.9 Jun 03 10:00:15.902679 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Auth-Token: gAAAAABimdt6_wxcFHi6XTjBtO5P5G9PuiMEej89QmXD-o-neLkoHBvJLn94NISmqUCNNuIgFphInFUxeIrvVMgi6Dc3NV60kGybnSL9fYW4fKy6w9_ryQIvNS60pbrz6Bfcv8lws-6uFQlrtFA1eqtlt9MqW1LeDWL-Xg1UzRcpC8yjeq6CWXc Jun 03 10:00:15.902679 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Id: None Jun 03 10:00:15.902679 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Name: None Jun 03 10:00:15.902679 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Identity-Status: Confirmed Jun 03 10:00:15.902679 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Is-Admin-Project: True Jun 03 10:00:15.902679 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Id: default Jun 03 10:00:15.902679 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Name: Default Jun 03 10:00:15.902679 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Id: 4e1793ba5f584cb0a9005c50d80c5c06 Jun 03 10:00:15.902679 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Name: tempest-VolumesActionsTest-1580277483 Jun 03 10:00:15.902679 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Role: member,reader Jun 03 10:00:15.902679 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Roles: member,reader Jun 03 10:00:15.903983 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4e1793ba5f584cb0a9005c50d80c5c06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e1793ba5f584cb0a9005c50d80c5c06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4e1793ba5f584cb0a9005c50d80c5c06", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e1793ba5f584cb0a9005c50d80c5c06"}]}] Jun 03 10:00:15.903983 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant: tempest-VolumesActionsTest-1580277483 Jun 03 10:00:15.903983 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Id: 4e1793ba5f584cb0a9005c50d80c5c06 Jun 03 10:00:15.903983 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Name: tempest-VolumesActionsTest-1580277483 Jun 03 10:00:15.903983 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User: tempest-VolumesActionsTest-1580277483-project Jun 03 10:00:15.903983 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Id: default Jun 03 10:00:15.903983 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Name: Default Jun 03 10:00:15.903983 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Id: 3dd300436c9545faa56d60ac290bc987 Jun 03 10:00:15.903983 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Name: tempest-VolumesActionsTest-1580277483-project Jun 03 10:00:15.903983 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: method: > Jun 03 10:00:15.903983 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: exception: Instance 321fb69e-316f-4254-93dc-d30bd9128a63 could not be found. Jun 03 10:00:15.903983 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: action_args: {'id': '321fb69e-316f-4254-93dc-d30bd9128a63'} Jun 03 10:00:15.904800 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:00:15.904800 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:00:15.904800 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:00:15.904800 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:00:15.904800 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:00:15.904800 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:00:15.904800 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:00:15.904800 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:00:15.904800 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:00:15.904800 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:00:15.904800 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 321fb69e-316f-4254-93dc-d30bd9128a63 could not be found. Jun 03 10:00:15.904800 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:00:15.904800 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:00:15.904800 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:00:15.904800 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:00:15.904800 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:00:15.904800 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:00:15.904800 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:00:15.904800 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:00:15.904800 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:00:15.906101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:00:15.906101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:00:15.906101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:00:15.906101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:00:15.906101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:00:15.906101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:00:15.906101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:00:15.906101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 321fb69e-316f-4254-93dc-d30bd9128a63 could not be found. Jun 03 10:00:15.906101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:00:15.906101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:00:15.906101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:00:15.906101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:00:15.906101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:00:15.906101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:00:15.906101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:00:15.906101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:00:15.906101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 321fb69e-316f-4254-93dc-d30bd9128a63 could not be found. Jun 03 10:00:15.906101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:00:15.908009 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-22359359-2d21-4703-9425-cc178a43da1c tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] Returning 404 to user: Instance 321fb69e-316f-4254-93dc-d30bd9128a63 could not be found. {{(pid=125065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:00:15.909024 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-22359359-2d21-4703-9425-cc178a43da1c tempest-VolumesActionsTest-1580277483 tempest-VolumesActionsTest-1580277483-project] 10.222.0.42 "GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63" status: 404 len: 111 microversion: 2.1 time: 0.039116 Jun 03 10:00:15.909734 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 144/293] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:15 2022] GET /compute/v2.1/servers/321fb69e-316f-4254-93dc-d30bd9128a63 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:00:16.101733 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-bf569369-340e-48ee-9b82-73f553c821ad tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:16.109647 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-bf569369-340e-48ee-9b82-73f553c821ad tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 200 len: 1514 microversion: 2.1 time: 0.254534 Jun 03 10:00:16.121546 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 150/294] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:15 2022] GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 1514 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:16.327644 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-3523eeeb-fc39-4f37-a3d3-3b3b8be0a0b2 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:16.328300 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-3523eeeb-fc39-4f37-a3d3-3b3b8be0a0b2 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:16.334769 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3523eeeb-fc39-4f37-a3d3-3b3b8be0a0b2 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:16.339941 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3523eeeb-fc39-4f37-a3d3-3b3b8be0a0b2 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:16.339941 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3523eeeb-fc39-4f37-a3d3-3b3b8be0a0b2 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:16.339941 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3523eeeb-fc39-4f37-a3d3-3b3b8be0a0b2 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:16.346902 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-0b95219a-a34d-4bac-a8fd-0949dcc59f7f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:16.347514 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-0b95219a-a34d-4bac-a8fd-0949dcc59f7f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:16.353776 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0b95219a-a34d-4bac-a8fd-0949dcc59f7f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:16.354498 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0b95219a-a34d-4bac-a8fd-0949dcc59f7f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:16.355497 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0b95219a-a34d-4bac-a8fd-0949dcc59f7f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:16.356261 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0b95219a-a34d-4bac-a8fd-0949dcc59f7f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:16.559359 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-3523eeeb-fc39-4f37-a3d3-3b3b8be0a0b2 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:16.562260 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-0b95219a-a34d-4bac-a8fd-0949dcc59f7f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:16.569721 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-3523eeeb-fc39-4f37-a3d3-3b3b8be0a0b2 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1726 microversion: 2.1 time: 0.246615 Jun 03 10:00:16.570539 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 145/295] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:16 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1726 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:16.580015 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-0b95219a-a34d-4bac-a8fd-0949dcc59f7f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:16.580015 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-0b95219a-a34d-4bac-a8fd-0949dcc59f7f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:16.580015 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-0b95219a-a34d-4bac-a8fd-0949dcc59f7f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1724 microversion: 2.20 time: 0.233174 Jun 03 10:00:16.580594 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 151/296] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:16 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:00:17.586307 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-e55e9c94-22e0-4b7b-82d0-58460b85926b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:17.586913 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-e55e9c94-22e0-4b7b-82d0-58460b85926b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:17.595844 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e55e9c94-22e0-4b7b-82d0-58460b85926b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:17.596397 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e55e9c94-22e0-4b7b-82d0-58460b85926b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:17.597243 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e55e9c94-22e0-4b7b-82d0-58460b85926b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:17.597351 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-2ac0ff76-085c-4901-8483-577b8d33105a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:17.597772 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e55e9c94-22e0-4b7b-82d0-58460b85926b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:17.598078 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-2ac0ff76-085c-4901-8483-577b8d33105a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:17.608186 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2ac0ff76-085c-4901-8483-577b8d33105a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:17.609644 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2ac0ff76-085c-4901-8483-577b8d33105a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:17.609644 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2ac0ff76-085c-4901-8483-577b8d33105a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:17.609932 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2ac0ff76-085c-4901-8483-577b8d33105a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:17.620254 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:17.817247 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-e55e9c94-22e0-4b7b-82d0-58460b85926b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:17.820762 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-2ac0ff76-085c-4901-8483-577b8d33105a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:17.827723 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-e55e9c94-22e0-4b7b-82d0-58460b85926b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1726 microversion: 2.1 time: 0.244917 Jun 03 10:00:17.828920 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 146/297] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:17 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1726 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:17.837669 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-2ac0ff76-085c-4901-8483-577b8d33105a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:17.839306 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-2ac0ff76-085c-4901-8483-577b8d33105a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:17.840546 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-2ac0ff76-085c-4901-8483-577b8d33105a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1724 microversion: 2.20 time: 0.247931 Jun 03 10:00:17.847527 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 152/298] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:17 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:00:18.084005 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-a887f084-3cad-4845-b51a-452ded3033e2 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Action: 'create', calling method: .version_select at 0x7f8d30066280>, body: {"keypair": {"name": "tempest-keypair-1298222962", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIFeKnTYvAqiH4rbZAaumjFsGZVWD1k33Fps2KYwB6tekPSA9blKtBZqMxyxR3ens/ukXi3hwbvBwUvu3NS2ugQmqBZmBeLp1xem0OqO9ur1vobA7MUYnD5irEoKbysnw=="}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:18.102964 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.quota [None req-a887f084-3cad-4845-b51a-452ded3033e2 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Getting quotas for project 071b399988474af1a1c709aac97c1744. Resources: {'key_pairs'} {{(pid=125065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:00:18.108885 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.quota [None req-a887f084-3cad-4845-b51a-452ded3033e2 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Getting quotas for user 6113d715500240098217caf641db763a and project 071b399988474af1a1c709aac97c1744. Resources: {'key_pairs'} {{(pid=125065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:00:18.218840 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-a887f084-3cad-4845-b51a-452ded3033e2 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.139769 Jun 03 10:00:18.219438 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 147/299] 10.222.0.42 () {60 vars in 1158 bytes} [Fri Jun 3 10:00:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:00:18.845233 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-c1b253fb-dee2-4b0d-ba90-f8bec6b7c8ff tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:18.845846 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-c1b253fb-dee2-4b0d-ba90-f8bec6b7c8ff tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:18.852706 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c1b253fb-dee2-4b0d-ba90-f8bec6b7c8ff tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:18.853171 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c1b253fb-dee2-4b0d-ba90-f8bec6b7c8ff tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:18.854509 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c1b253fb-dee2-4b0d-ba90-f8bec6b7c8ff tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:18.854953 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c1b253fb-dee2-4b0d-ba90-f8bec6b7c8ff tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:18.867784 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-138b4465-c733-4154-ba25-61741eccd3fc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:18.869146 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-138b4465-c733-4154-ba25-61741eccd3fc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:18.885331 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-138b4465-c733-4154-ba25-61741eccd3fc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:18.885761 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-138b4465-c733-4154-ba25-61741eccd3fc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:18.886753 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-138b4465-c733-4154-ba25-61741eccd3fc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:18.887178 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-138b4465-c733-4154-ba25-61741eccd3fc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:19.110675 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-138b4465-c733-4154-ba25-61741eccd3fc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:19.114952 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-c1b253fb-dee2-4b0d-ba90-f8bec6b7c8ff tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:19.120299 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-138b4465-c733-4154-ba25-61741eccd3fc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:19.122145 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-138b4465-c733-4154-ba25-61741eccd3fc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:19.123425 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-138b4465-c733-4154-ba25-61741eccd3fc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1724 microversion: 2.20 time: 0.263441 Jun 03 10:00:19.123989 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 148/300] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:18 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1724 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:00:19.125513 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-c1b253fb-dee2-4b0d-ba90-f8bec6b7c8ff tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1726 microversion: 2.1 time: 0.284119 Jun 03 10:00:19.126240 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 153/301] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:18 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1726 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:20.142216 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-a271e0fd-547f-4771-998b-058d92138362 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:20.142829 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-a271e0fd-547f-4771-998b-058d92138362 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:20.150132 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a271e0fd-547f-4771-998b-058d92138362 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:20.150587 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a271e0fd-547f-4771-998b-058d92138362 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:20.151914 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a271e0fd-547f-4771-998b-058d92138362 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:20.152353 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a271e0fd-547f-4771-998b-058d92138362 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:20.155403 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-c6c5636e-7bbc-49fd-a84b-4df08f6e5d01 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:20.156002 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-c6c5636e-7bbc-49fd-a84b-4df08f6e5d01 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:20.162631 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c6c5636e-7bbc-49fd-a84b-4df08f6e5d01 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:20.163295 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c6c5636e-7bbc-49fd-a84b-4df08f6e5d01 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:20.164051 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c6c5636e-7bbc-49fd-a84b-4df08f6e5d01 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:20.164483 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c6c5636e-7bbc-49fd-a84b-4df08f6e5d01 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:20.384151 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-a271e0fd-547f-4771-998b-058d92138362 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:20.392297 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-a271e0fd-547f-4771-998b-058d92138362 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:20.399521 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-a271e0fd-547f-4771-998b-058d92138362 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:20.399521 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-a271e0fd-547f-4771-998b-058d92138362 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1724 microversion: 2.20 time: 0.256865 Jun 03 10:00:20.399521 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 149/302] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:20 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:20.409645 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-c6c5636e-7bbc-49fd-a84b-4df08f6e5d01 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:20.418299 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-c6c5636e-7bbc-49fd-a84b-4df08f6e5d01 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1726 microversion: 2.1 time: 0.267213 Jun 03 10:00:20.418960 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 154/303] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:20 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1726 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:20.882726 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-d7269ef9-b303-4135-a5c2-8a9c4387a459 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1450689313", "imageRef": "0d2dd03b-4531-46f3-88da-0380e97b1bd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "27ad8cbb-ba5a-4502-afc9-811304412397"}], "security_groups": [{"name": "tempest-securitygroup--1090390200"}], "key_name": "tempest-keypair-1298222962", "user_data": "}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:20.983939 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.network.neutron [None req-d7269ef9-b303-4135-a5c2-8a9c4387a459 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] validate_networks() for [('27ad8cbb-ba5a-4502-afc9-811304412397', None, None, None, None, None)] {{(pid=125065) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 10:00:21.162775 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:21.412906 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-88211825-d6e4-4703-b419-9275843862eb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:21.413657 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-88211825-d6e4-4703-b419-9275843862eb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:21.419755 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-88211825-d6e4-4703-b419-9275843862eb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:21.420399 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-88211825-d6e4-4703-b419-9275843862eb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:21.421212 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-88211825-d6e4-4703-b419-9275843862eb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:21.421713 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-88211825-d6e4-4703-b419-9275843862eb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:21.620453 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-88211825-d6e4-4703-b419-9275843862eb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:21.628953 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-88211825-d6e4-4703-b419-9275843862eb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:21.631407 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-88211825-d6e4-4703-b419-9275843862eb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:21.631964 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-88211825-d6e4-4703-b419-9275843862eb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1724 microversion: 2.20 time: 0.223027 Jun 03 10:00:21.632526 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 155/304] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:21 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:00:21.638240 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-1199fc64-fe99-40e7-b0a9-e85a765d80ff tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:21.638485 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-d7269ef9-b303-4135-a5c2-8a9c4387a459 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Flavor limits 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 10:00:21.638851 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-1199fc64-fe99-40e7-b0a9-e85a765d80ff tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:21.638968 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-d7269ef9-b303-4135-a5c2-8a9c4387a459 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Image limits 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 10:00:21.639369 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-d7269ef9-b303-4135-a5c2-8a9c4387a459 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Flavor pref 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 10:00:21.639830 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-d7269ef9-b303-4135-a5c2-8a9c4387a459 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Image pref 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 10:00:21.640268 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-d7269ef9-b303-4135-a5c2-8a9c4387a459 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 10:00:21.645027 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1199fc64-fe99-40e7-b0a9-e85a765d80ff tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:21.645554 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1199fc64-fe99-40e7-b0a9-e85a765d80ff tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:21.646507 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1199fc64-fe99-40e7-b0a9-e85a765d80ff tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:21.646944 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1199fc64-fe99-40e7-b0a9-e85a765d80ff tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:21.649422 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d7269ef9-b303-4135-a5c2-8a9c4387a459 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:21.650057 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d7269ef9-b303-4135-a5c2-8a9c4387a459 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:21.650978 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d7269ef9-b303-4135-a5c2-8a9c4387a459 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:21.651481 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d7269ef9-b303-4135-a5c2-8a9c4387a459 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:21.669713 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.quota [None req-d7269ef9-b303-4135-a5c2-8a9c4387a459 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Getting quotas for project 071b399988474af1a1c709aac97c1744. Resources: {'ram', 'instances', 'cores'} {{(pid=125065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:00:21.673843 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.quota [None req-d7269ef9-b303-4135-a5c2-8a9c4387a459 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Getting quotas for user 6113d715500240098217caf641db763a and project 071b399988474af1a1c709aac97c1744. Resources: {'ram', 'instances', 'cores'} {{(pid=125065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:00:21.685441 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-d7269ef9-b303-4135-a5c2-8a9c4387a459 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Going to run 1 instances... {{(pid=125065) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 10:00:21.687916 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-d7269ef9-b303-4135-a5c2-8a9c4387a459 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2dd03b-4531-46f3-88da-0380e97b1bd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 10:00:21.783499 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-1199fc64-fe99-40e7-b0a9-e85a765d80ff tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:21.792592 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-1199fc64-fe99-40e7-b0a9-e85a765d80ff tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1726 microversion: 2.1 time: 0.158941 Jun 03 10:00:21.793160 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 156/305] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:21 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:21.836060 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-d7269ef9-b303-4135-a5c2-8a9c4387a459 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.957980 Jun 03 10:00:21.836783 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 150/306] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 3 10:00:20 2022] POST /compute/v2.1/servers => generated 409 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 10:00:21.846448 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-199ee012-bef1-4212-bc30-63fa436713c1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:21.846982 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-199ee012-bef1-4212-bc30-63fa436713c1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:21.899331 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-199ee012-bef1-4212-bc30-63fa436713c1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:21.906035 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-199ee012-bef1-4212-bc30-63fa436713c1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1246 microversion: 2.1 time: 0.063329 Jun 03 10:00:21.912788 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 157/307] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:21 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1246 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:22.652067 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-b1e722de-cec9-4bc2-b7f8-e00300274421 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:22.652518 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-b1e722de-cec9-4bc2-b7f8-e00300274421 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:22.658996 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b1e722de-cec9-4bc2-b7f8-e00300274421 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:22.659465 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b1e722de-cec9-4bc2-b7f8-e00300274421 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:22.660270 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b1e722de-cec9-4bc2-b7f8-e00300274421 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:22.660750 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b1e722de-cec9-4bc2-b7f8-e00300274421 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:22.802768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-b1e722de-cec9-4bc2-b7f8-e00300274421 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:22.813499 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-b1e722de-cec9-4bc2-b7f8-e00300274421 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:22.821498 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-02a1e3e1-6937-4002-bd85-440d3a5e73c5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:22.822155 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-b1e722de-cec9-4bc2-b7f8-e00300274421 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:22.822355 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-02a1e3e1-6937-4002-bd85-440d3a5e73c5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:22.822446 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-b1e722de-cec9-4bc2-b7f8-e00300274421 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1724 microversion: 2.20 time: 0.170254 Jun 03 10:00:22.822446 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 151/308] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:22 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:22.825251 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-02a1e3e1-6937-4002-bd85-440d3a5e73c5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:22.825703 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-02a1e3e1-6937-4002-bd85-440d3a5e73c5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:22.826519 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-02a1e3e1-6937-4002-bd85-440d3a5e73c5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:22.827143 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-02a1e3e1-6937-4002-bd85-440d3a5e73c5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:22.923149 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-889c4a0b-756b-44da-9f10-3fdc553ada93 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:22.923857 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-889c4a0b-756b-44da-9f10-3fdc553ada93 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:22.929950 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-889c4a0b-756b-44da-9f10-3fdc553ada93 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:22.930562 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-889c4a0b-756b-44da-9f10-3fdc553ada93 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:22.931496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-889c4a0b-756b-44da-9f10-3fdc553ada93 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:22.932456 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-889c4a0b-756b-44da-9f10-3fdc553ada93 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:23.008976 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-889c4a0b-756b-44da-9f10-3fdc553ada93 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:23.014769 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-02a1e3e1-6937-4002-bd85-440d3a5e73c5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:23.018746 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-889c4a0b-756b-44da-9f10-3fdc553ada93 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1250 microversion: 2.1 time: 0.099701 Jun 03 10:00:23.019291 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 152/309] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:22 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1250 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:23.024117 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-02a1e3e1-6937-4002-bd85-440d3a5e73c5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1726 microversion: 2.1 time: 0.217409 Jun 03 10:00:23.024755 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 158/310] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:22 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1726 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:23.838281 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-7cd43457-f3a2-41e4-bf23-fc5214ccd2ac tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:23.838876 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-7cd43457-f3a2-41e4-bf23-fc5214ccd2ac tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:23.845445 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7cd43457-f3a2-41e4-bf23-fc5214ccd2ac tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:23.845927 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7cd43457-f3a2-41e4-bf23-fc5214ccd2ac tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:23.846720 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7cd43457-f3a2-41e4-bf23-fc5214ccd2ac tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:23.847226 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7cd43457-f3a2-41e4-bf23-fc5214ccd2ac tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:24.042119 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-110d86f3-1cac-418b-a6be-43af85087da8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:24.046349 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-110d86f3-1cac-418b-a6be-43af85087da8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:24.051651 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-7cd43457-f3a2-41e4-bf23-fc5214ccd2ac tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:24.056039 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-110d86f3-1cac-418b-a6be-43af85087da8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:24.056976 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-110d86f3-1cac-418b-a6be-43af85087da8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:24.058339 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-110d86f3-1cac-418b-a6be-43af85087da8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:24.059093 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-110d86f3-1cac-418b-a6be-43af85087da8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:24.068827 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-7cd43457-f3a2-41e4-bf23-fc5214ccd2ac tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:24.070492 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-7cd43457-f3a2-41e4-bf23-fc5214ccd2ac tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:24.071815 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-7cd43457-f3a2-41e4-bf23-fc5214ccd2ac tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1724 microversion: 2.20 time: 0.237381 Jun 03 10:00:24.073246 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 153/311] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:23 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:24.078776 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-6e47b94d-122a-4715-8398-9c95949ef447 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:24.079640 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-6e47b94d-122a-4715-8398-9c95949ef447 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:24.095238 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6e47b94d-122a-4715-8398-9c95949ef447 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:24.095714 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6e47b94d-122a-4715-8398-9c95949ef447 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:24.096548 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6e47b94d-122a-4715-8398-9c95949ef447 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:24.096995 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6e47b94d-122a-4715-8398-9c95949ef447 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:24.225075 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-110d86f3-1cac-418b-a6be-43af85087da8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:24.238111 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-110d86f3-1cac-418b-a6be-43af85087da8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1298 microversion: 2.1 time: 0.204772 Jun 03 10:00:24.239009 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 159/312] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:24 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1298 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:24.357488 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-6e47b94d-122a-4715-8398-9c95949ef447 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:24.374079 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-6e47b94d-122a-4715-8398-9c95949ef447 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1726 microversion: 2.1 time: 0.290956 Jun 03 10:00:24.374079 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 154/313] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:24 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1726 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:25.090419 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-5d33b9e6-0de7-463d-b041-8410b4d57da1 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:25.091034 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-5d33b9e6-0de7-463d-b041-8410b4d57da1 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:25.101107 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5d33b9e6-0de7-463d-b041-8410b4d57da1 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:25.101559 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5d33b9e6-0de7-463d-b041-8410b4d57da1 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:25.102369 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5d33b9e6-0de7-463d-b041-8410b4d57da1 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:25.103682 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5d33b9e6-0de7-463d-b041-8410b4d57da1 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:25.266761 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-9773f7b9-1125-4d79-aa14-04e9901570d8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:25.267596 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-9773f7b9-1125-4d79-aa14-04e9901570d8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:25.273859 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-5d33b9e6-0de7-463d-b041-8410b4d57da1 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:25.294673 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9773f7b9-1125-4d79-aa14-04e9901570d8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:25.294673 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9773f7b9-1125-4d79-aa14-04e9901570d8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:25.295631 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9773f7b9-1125-4d79-aa14-04e9901570d8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:25.295631 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9773f7b9-1125-4d79-aa14-04e9901570d8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:25.298928 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-5d33b9e6-0de7-463d-b041-8410b4d57da1 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:25.300642 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-5d33b9e6-0de7-463d-b041-8410b4d57da1 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:25.301859 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-5d33b9e6-0de7-463d-b041-8410b4d57da1 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1724 microversion: 2.20 time: 0.215738 Jun 03 10:00:25.308192 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 160/314] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:25 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:25.389958 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-eb29c00e-cdf5-41a9-aaaa-1441467b7c21 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:25.390809 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-eb29c00e-cdf5-41a9-aaaa-1441467b7c21 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:25.404100 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-eb29c00e-cdf5-41a9-aaaa-1441467b7c21 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:25.404543 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-eb29c00e-cdf5-41a9-aaaa-1441467b7c21 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:25.409815 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-eb29c00e-cdf5-41a9-aaaa-1441467b7c21 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:25.410457 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-eb29c00e-cdf5-41a9-aaaa-1441467b7c21 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:25.696812 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-9773f7b9-1125-4d79-aa14-04e9901570d8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:25.708897 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-9773f7b9-1125-4d79-aa14-04e9901570d8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1372 microversion: 2.1 time: 0.446027 Jun 03 10:00:25.710428 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 155/315] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:25 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1372 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:25.748907 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-eb29c00e-cdf5-41a9-aaaa-1441467b7c21 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:25.776344 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-eb29c00e-cdf5-41a9-aaaa-1441467b7c21 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1726 microversion: 2.1 time: 0.395246 Jun 03 10:00:25.776344 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 161/316] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:25 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1726 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:26.321293 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-ff6fa728-b5c3-469f-be5b-14290678dc4a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:26.323318 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-ff6fa728-b5c3-469f-be5b-14290678dc4a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:26.330759 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ff6fa728-b5c3-469f-be5b-14290678dc4a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:26.333065 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ff6fa728-b5c3-469f-be5b-14290678dc4a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:26.333065 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ff6fa728-b5c3-469f-be5b-14290678dc4a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:26.333065 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ff6fa728-b5c3-469f-be5b-14290678dc4a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:26.546967 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-ff6fa728-b5c3-469f-be5b-14290678dc4a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:26.559556 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-ff6fa728-b5c3-469f-be5b-14290678dc4a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:26.561423 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-ff6fa728-b5c3-469f-be5b-14290678dc4a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:26.562660 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-ff6fa728-b5c3-469f-be5b-14290678dc4a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1745 microversion: 2.20 time: 0.246213 Jun 03 10:00:26.573992 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 156/317] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:26 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1745 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:26.676911 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-6ba7f08a-7a00-48c3-b854-562f2ab02f44 req-9d837d33-c8e4-4957-8d35-32e0b76cfe1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5809214c-e01c-4ff2-adbf-097cf27a9846", "tag": "fce52c81-17cf-4133-980e-d0dda0f0288a"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:26.701757 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-6ba7f08a-7a00-48c3-b854-562f2ab02f44 req-9d837d33-c8e4-4957-8d35-32e0b76cfe1f service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:26.706743 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-6ba7f08a-7a00-48c3-b854-562f2ab02f44 req-9d837d33-c8e4-4957-8d35-32e0b76cfe1f service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:26.726880 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-26b4adef-7b6a-4374-ba83-a447cfd31e78 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:26.728040 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-26b4adef-7b6a-4374-ba83-a447cfd31e78 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:26.743592 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-26b4adef-7b6a-4374-ba83-a447cfd31e78 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:26.752431 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-26b4adef-7b6a-4374-ba83-a447cfd31e78 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:26.752679 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-6ba7f08a-7a00-48c3-b854-562f2ab02f44 req-9d837d33-c8e4-4957-8d35-32e0b76cfe1f service nova] Creating event network-changed:fce52c81-17cf-4133-980e-d0dda0f0288a for instance 5809214c-e01c-4ff2-adbf-097cf27a9846 on hv-cinder-84456 Jun 03 10:00:26.753192 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-26b4adef-7b6a-4374-ba83-a447cfd31e78 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:26.754002 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-26b4adef-7b6a-4374-ba83-a447cfd31e78 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:26.768334 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-6ba7f08a-7a00-48c3-b854-562f2ab02f44 req-9d837d33-c8e4-4957-8d35-32e0b76cfe1f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095824 Jun 03 10:00:26.770577 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 162/318] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:00:26.795353 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-a2c2774a-7897-454e-9292-6ff889dffb10 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:26.796335 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-a2c2774a-7897-454e-9292-6ff889dffb10 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:26.809168 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a2c2774a-7897-454e-9292-6ff889dffb10 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:26.811099 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a2c2774a-7897-454e-9292-6ff889dffb10 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:26.812301 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a2c2774a-7897-454e-9292-6ff889dffb10 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:26.818374 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a2c2774a-7897-454e-9292-6ff889dffb10 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:27.187350 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-26b4adef-7b6a-4374-ba83-a447cfd31e78 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:27.193827 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-a2c2774a-7897-454e-9292-6ff889dffb10 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:27.196649 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-26b4adef-7b6a-4374-ba83-a447cfd31e78 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1372 microversion: 2.1 time: 0.473577 Jun 03 10:00:27.200738 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 157/319] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:26 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1372 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:27.205449 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-a2c2774a-7897-454e-9292-6ff889dffb10 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1726 microversion: 2.1 time: 0.413660 Jun 03 10:00:27.206496 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 163/320] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:26 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1726 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:27.582338 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-e1f4a5cd-f241-4fc8-8e4e-a7027f886bf9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:27.582971 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-e1f4a5cd-f241-4fc8-8e4e-a7027f886bf9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:27.592958 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e1f4a5cd-f241-4fc8-8e4e-a7027f886bf9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:27.595824 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e1f4a5cd-f241-4fc8-8e4e-a7027f886bf9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:27.600451 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e1f4a5cd-f241-4fc8-8e4e-a7027f886bf9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:27.600451 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e1f4a5cd-f241-4fc8-8e4e-a7027f886bf9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:27.934137 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-e1f4a5cd-f241-4fc8-8e4e-a7027f886bf9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:27.958917 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-e1f4a5cd-f241-4fc8-8e4e-a7027f886bf9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:27.976672 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-e1f4a5cd-f241-4fc8-8e4e-a7027f886bf9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:27.978338 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-e1f4a5cd-f241-4fc8-8e4e-a7027f886bf9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1745 microversion: 2.20 time: 0.401550 Jun 03 10:00:27.980317 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 158/321] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:27 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1745 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:28.217517 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-a037a4f2-a400-4221-9f16-fd3abbaec290 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:28.218382 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-a037a4f2-a400-4221-9f16-fd3abbaec290 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:28.226339 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-456cde80-841e-4af2-9d45-1ee810e54d02 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:28.226616 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a037a4f2-a400-4221-9f16-fd3abbaec290 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:28.227069 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a037a4f2-a400-4221-9f16-fd3abbaec290 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:28.227193 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-456cde80-841e-4af2-9d45-1ee810e54d02 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:28.228198 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a037a4f2-a400-4221-9f16-fd3abbaec290 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:28.229354 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a037a4f2-a400-4221-9f16-fd3abbaec290 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:28.234350 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-456cde80-841e-4af2-9d45-1ee810e54d02 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:28.235027 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-456cde80-841e-4af2-9d45-1ee810e54d02 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:28.237441 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-456cde80-841e-4af2-9d45-1ee810e54d02 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:28.237919 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-456cde80-841e-4af2-9d45-1ee810e54d02 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:28.510783 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-456cde80-841e-4af2-9d45-1ee810e54d02 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:28.518337 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-a037a4f2-a400-4221-9f16-fd3abbaec290 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:28.521923 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-456cde80-841e-4af2-9d45-1ee810e54d02 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1726 microversion: 2.1 time: 0.299395 Jun 03 10:00:28.523092 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 159/322] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:28 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1726 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:28.536140 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-a037a4f2-a400-4221-9f16-fd3abbaec290 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1372 microversion: 2.1 time: 0.323725 Jun 03 10:00:28.537631 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 164/323] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:28 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1372 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:29.000560 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-aaa42740-6b85-4828-849a-04e12e1a6448 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:29.001525 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-aaa42740-6b85-4828-849a-04e12e1a6448 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:29.009867 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-aaa42740-6b85-4828-849a-04e12e1a6448 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:29.011174 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-aaa42740-6b85-4828-849a-04e12e1a6448 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:29.012584 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-aaa42740-6b85-4828-849a-04e12e1a6448 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:29.013226 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-aaa42740-6b85-4828-849a-04e12e1a6448 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:29.153491 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-aaa42740-6b85-4828-849a-04e12e1a6448 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:29.168392 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-aaa42740-6b85-4828-849a-04e12e1a6448 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:29.168392 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-aaa42740-6b85-4828-849a-04e12e1a6448 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:29.168392 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-aaa42740-6b85-4828-849a-04e12e1a6448 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1745 microversion: 2.20 time: 0.170406 Jun 03 10:00:29.168930 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 160/324] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:28 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:29.384376 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-54f09c5e-15d8-4322-b667-4ef2967f90d3 req-86f90c57-d237-4d53-accb-c33ceda440a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6517823d-711a-4e24-9cdf-27812d522a46", "name": "network-vif-plugged", "status": "completed", "tag": "a93886de-f812-40e6-81ba-b35e06454a66"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:29.394371 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-54f09c5e-15d8-4322-b667-4ef2967f90d3 req-86f90c57-d237-4d53-accb-c33ceda440a7 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:29.394846 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-54f09c5e-15d8-4322-b667-4ef2967f90d3 req-86f90c57-d237-4d53-accb-c33ceda440a7 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:29.408336 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-54f09c5e-15d8-4322-b667-4ef2967f90d3 req-86f90c57-d237-4d53-accb-c33ceda440a7 service nova] Creating event network-vif-plugged:a93886de-f812-40e6-81ba-b35e06454a66 for instance 6517823d-711a-4e24-9cdf-27812d522a46 on hv-cinder-84456 Jun 03 10:00:29.413462 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-54f09c5e-15d8-4322-b667-4ef2967f90d3 req-86f90c57-d237-4d53-accb-c33ceda440a7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033704 Jun 03 10:00:29.414588 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 165/325] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:00:29.544725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-bbc95695-ef8e-408a-831e-310e04fedb39 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:29.545688 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-bbc95695-ef8e-408a-831e-310e04fedb39 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:29.553243 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-0a71ea42-3b44-461f-9a9d-cb33c3e4ce66 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:29.556364 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-0a71ea42-3b44-461f-9a9d-cb33c3e4ce66 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:29.562252 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-bbc95695-ef8e-408a-831e-310e04fedb39 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:29.562526 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0a71ea42-3b44-461f-9a9d-cb33c3e4ce66 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:29.562992 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0a71ea42-3b44-461f-9a9d-cb33c3e4ce66 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:29.563322 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-bbc95695-ef8e-408a-831e-310e04fedb39 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:29.564133 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0a71ea42-3b44-461f-9a9d-cb33c3e4ce66 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:29.564374 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-bbc95695-ef8e-408a-831e-310e04fedb39 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:29.564877 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0a71ea42-3b44-461f-9a9d-cb33c3e4ce66 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:29.564991 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-bbc95695-ef8e-408a-831e-310e04fedb39 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:29.786415 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-0a71ea42-3b44-461f-9a9d-cb33c3e4ce66 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:29.789631 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-bbc95695-ef8e-408a-831e-310e04fedb39 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:29.794607 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-0a71ea42-3b44-461f-9a9d-cb33c3e4ce66 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1372 microversion: 2.1 time: 0.245570 Jun 03 10:00:29.795265 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 166/326] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:29 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1372 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:29.798772 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-bbc95695-ef8e-408a-831e-310e04fedb39 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1726 microversion: 2.1 time: 0.261875 Jun 03 10:00:29.802283 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 161/327] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:29 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1726 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:30.182304 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-bbacd7bf-d895-4132-8e5f-ff427f6f38be tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:30.182941 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-bbacd7bf-d895-4132-8e5f-ff427f6f38be tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:30.188955 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bbacd7bf-d895-4132-8e5f-ff427f6f38be tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:30.189405 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bbacd7bf-d895-4132-8e5f-ff427f6f38be tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:30.190194 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bbacd7bf-d895-4132-8e5f-ff427f6f38be tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:30.190628 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bbacd7bf-d895-4132-8e5f-ff427f6f38be tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:30.317758 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-bbacd7bf-d895-4132-8e5f-ff427f6f38be tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:30.320100 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:SELECT=100 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:30.327109 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-bbacd7bf-d895-4132-8e5f-ff427f6f38be tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:30.328615 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-bbacd7bf-d895-4132-8e5f-ff427f6f38be tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:30.329816 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-bbacd7bf-d895-4132-8e5f-ff427f6f38be tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1740 microversion: 2.20 time: 0.151462 Jun 03 10:00:30.330412 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 167/328] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:30 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1740 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:30.811744 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-95a4eb0a-64ed-49f3-82e2-6fdd08798441 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:30.812362 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-95a4eb0a-64ed-49f3-82e2-6fdd08798441 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:30.816938 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-d5485a83-bead-4a88-8b81-25b4fa716778 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:30.817544 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-d5485a83-bead-4a88-8b81-25b4fa716778 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:30.818984 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-95a4eb0a-64ed-49f3-82e2-6fdd08798441 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:30.819446 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-95a4eb0a-64ed-49f3-82e2-6fdd08798441 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:30.820214 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-95a4eb0a-64ed-49f3-82e2-6fdd08798441 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:30.820655 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-95a4eb0a-64ed-49f3-82e2-6fdd08798441 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:30.824283 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d5485a83-bead-4a88-8b81-25b4fa716778 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:30.824731 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d5485a83-bead-4a88-8b81-25b4fa716778 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:30.825486 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d5485a83-bead-4a88-8b81-25b4fa716778 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:30.825944 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d5485a83-bead-4a88-8b81-25b4fa716778 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:31.227444 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-95a4eb0a-64ed-49f3-82e2-6fdd08798441 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:31.231893 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-d5485a83-bead-4a88-8b81-25b4fa716778 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:31.236610 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-95a4eb0a-64ed-49f3-82e2-6fdd08798441 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1372 microversion: 2.1 time: 0.427896 Jun 03 10:00:31.236610 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 162/329] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:30 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1372 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:31.240025 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-d5485a83-bead-4a88-8b81-25b4fa716778 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1726 microversion: 2.1 time: 0.426781 Jun 03 10:00:31.240611 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 168/330] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:30 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1726 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:31.348236 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-d5378862-aa2d-4d0a-984f-01ee4eb34e7b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:31.348838 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-d5378862-aa2d-4d0a-984f-01ee4eb34e7b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:31.355477 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d5378862-aa2d-4d0a-984f-01ee4eb34e7b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:31.355926 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d5378862-aa2d-4d0a-984f-01ee4eb34e7b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:31.356678 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d5378862-aa2d-4d0a-984f-01ee4eb34e7b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:31.357108 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d5378862-aa2d-4d0a-984f-01ee4eb34e7b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:31.480546 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-d5378862-aa2d-4d0a-984f-01ee4eb34e7b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:31.488417 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-d5378862-aa2d-4d0a-984f-01ee4eb34e7b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:31.490101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-d5378862-aa2d-4d0a-984f-01ee4eb34e7b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:31.491251 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-d5378862-aa2d-4d0a-984f-01ee4eb34e7b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1740 microversion: 2.20 time: 0.146930 Jun 03 10:00:31.491835 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 163/331] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:31 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1740 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:00:32.252565 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-b805c093-316a-4bb1-97f0-c5864f9b39c3 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:32.253215 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-b805c093-316a-4bb1-97f0-c5864f9b39c3 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:32.255205 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell0:SELECT=2 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:32.256808 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-5f1803b0-e7aa-4f1e-a639-f086893c084d tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:32.257253 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-5f1803b0-e7aa-4f1e-a639-f086893c084d tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:32.258736 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell0:SELECT=2 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:32.259397 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell0:SELECT=10 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:32.260285 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b805c093-316a-4bb1-97f0-c5864f9b39c3 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:32.260734 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b805c093-316a-4bb1-97f0-c5864f9b39c3 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:32.261772 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b805c093-316a-4bb1-97f0-c5864f9b39c3 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:32.262273 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b805c093-316a-4bb1-97f0-c5864f9b39c3 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:32.264960 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5f1803b0-e7aa-4f1e-a639-f086893c084d tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:32.265406 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5f1803b0-e7aa-4f1e-a639-f086893c084d tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:32.266181 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5f1803b0-e7aa-4f1e-a639-f086893c084d tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:32.266610 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5f1803b0-e7aa-4f1e-a639-f086893c084d tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:32.461664 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-b805c093-316a-4bb1-97f0-c5864f9b39c3 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:32.466149 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-5f1803b0-e7aa-4f1e-a639-f086893c084d tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:32.470064 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=100 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:32.470222 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-b805c093-316a-4bb1-97f0-c5864f9b39c3 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1372 microversion: 2.1 time: 0.221241 Jun 03 10:00:32.475293 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-5f1803b0-e7aa-4f1e-a639-f086893c084d tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1726 microversion: 2.1 time: 0.222852 Jun 03 10:00:32.480313 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 169/332] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:32 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1372 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:32.485774 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 164/333] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:32 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1726 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:32.508802 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-262a6b19-98da-4f0f-904c-7a0c6f04ab92 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:32.509394 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-262a6b19-98da-4f0f-904c-7a0c6f04ab92 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:32.516924 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-262a6b19-98da-4f0f-904c-7a0c6f04ab92 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:32.517571 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-262a6b19-98da-4f0f-904c-7a0c6f04ab92 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:32.518462 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-262a6b19-98da-4f0f-904c-7a0c6f04ab92 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:32.518900 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-262a6b19-98da-4f0f-904c-7a0c6f04ab92 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:32.665717 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-262a6b19-98da-4f0f-904c-7a0c6f04ab92 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:32.673998 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-262a6b19-98da-4f0f-904c-7a0c6f04ab92 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:32.681229 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-262a6b19-98da-4f0f-904c-7a0c6f04ab92 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:32.681229 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-262a6b19-98da-4f0f-904c-7a0c6f04ab92 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1740 microversion: 2.20 time: 0.171675 Jun 03 10:00:32.681229 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 170/334] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:32 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:33.487634 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-fc0cee71-dc8a-41f9-9ab8-0b57cae76d5a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:33.488172 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-fc0cee71-dc8a-41f9-9ab8-0b57cae76d5a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:33.492632 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-16017ac3-0eda-41f9-9a79-04f1eedcaafd tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:33.493244 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-16017ac3-0eda-41f9-9a79-04f1eedcaafd tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:33.495109 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-fc0cee71-dc8a-41f9-9ab8-0b57cae76d5a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:33.495556 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-fc0cee71-dc8a-41f9-9ab8-0b57cae76d5a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:33.496321 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-fc0cee71-dc8a-41f9-9ab8-0b57cae76d5a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:33.496752 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-fc0cee71-dc8a-41f9-9ab8-0b57cae76d5a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:33.499301 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-16017ac3-0eda-41f9-9a79-04f1eedcaafd tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:33.499943 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-16017ac3-0eda-41f9-9a79-04f1eedcaafd tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:33.500741 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-16017ac3-0eda-41f9-9a79-04f1eedcaafd tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:33.501179 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-16017ac3-0eda-41f9-9a79-04f1eedcaafd tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:33.707012 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-fc0cee71-dc8a-41f9-9ab8-0b57cae76d5a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:33.721240 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-fc0cee71-dc8a-41f9-9ab8-0b57cae76d5a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1372 microversion: 2.1 time: 0.233926 Jun 03 10:00:33.722379 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 165/335] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:33 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1372 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:33.727972 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-fa789eea-d0c1-4e75-97de-1a41dee501f1 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:33.729433 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-fa789eea-d0c1-4e75-97de-1a41dee501f1 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:33.733120 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-16017ac3-0eda-41f9-9a79-04f1eedcaafd tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:33.742745 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-16017ac3-0eda-41f9-9a79-04f1eedcaafd tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1726 microversion: 2.1 time: 0.253941 Jun 03 10:00:33.743525 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 171/336] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:33 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1726 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:33.745124 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-fa789eea-d0c1-4e75-97de-1a41dee501f1 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:33.747353 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-fa789eea-d0c1-4e75-97de-1a41dee501f1 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:33.749948 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-fa789eea-d0c1-4e75-97de-1a41dee501f1 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:33.751733 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-fa789eea-d0c1-4e75-97de-1a41dee501f1 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:33.888455 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-fa789eea-d0c1-4e75-97de-1a41dee501f1 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:33.904980 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-fa789eea-d0c1-4e75-97de-1a41dee501f1 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:33.907949 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-fa789eea-d0c1-4e75-97de-1a41dee501f1 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:33.912231 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-fa789eea-d0c1-4e75-97de-1a41dee501f1 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1740 microversion: 2.20 time: 0.185758 Jun 03 10:00:33.912231 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 166/337] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:33 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:34.739143 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-88df7c5c-f8d1-48ba-8c12-8712470c51b9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:34.740403 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-88df7c5c-f8d1-48ba-8c12-8712470c51b9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:34.756942 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-88df7c5c-f8d1-48ba-8c12-8712470c51b9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:34.757444 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-88df7c5c-f8d1-48ba-8c12-8712470c51b9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:34.758312 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-88df7c5c-f8d1-48ba-8c12-8712470c51b9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:34.758777 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-88df7c5c-f8d1-48ba-8c12-8712470c51b9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:34.761648 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-14e320ed-f78e-4a4f-9289-64268b6b0885 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:34.762832 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-14e320ed-f78e-4a4f-9289-64268b6b0885 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:34.772114 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-14e320ed-f78e-4a4f-9289-64268b6b0885 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:34.773031 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-14e320ed-f78e-4a4f-9289-64268b6b0885 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:34.774569 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-14e320ed-f78e-4a4f-9289-64268b6b0885 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:34.775971 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-14e320ed-f78e-4a4f-9289-64268b6b0885 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:35.003092 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-88df7c5c-f8d1-48ba-8c12-8712470c51b9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:35.013244 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-88df7c5c-f8d1-48ba-8c12-8712470c51b9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1372 microversion: 2.1 time: 0.279148 Jun 03 10:00:35.026059 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 172/338] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:34 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1372 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:35.031413 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-073ebaf9-6b26-4d9c-a998-8c3f1b3bd0c6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:35.032022 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-073ebaf9-6b26-4d9c-a998-8c3f1b3bd0c6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:35.038492 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-073ebaf9-6b26-4d9c-a998-8c3f1b3bd0c6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:35.039049 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-073ebaf9-6b26-4d9c-a998-8c3f1b3bd0c6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:35.040389 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-073ebaf9-6b26-4d9c-a998-8c3f1b3bd0c6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:35.040854 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-073ebaf9-6b26-4d9c-a998-8c3f1b3bd0c6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:35.041124 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-14e320ed-f78e-4a4f-9289-64268b6b0885 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:35.052664 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-14e320ed-f78e-4a4f-9289-64268b6b0885 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1726 microversion: 2.1 time: 0.296091 Jun 03 10:00:35.053601 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 167/339] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:34 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1726 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:35.369281 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-073ebaf9-6b26-4d9c-a998-8c3f1b3bd0c6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:35.392956 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-073ebaf9-6b26-4d9c-a998-8c3f1b3bd0c6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:35.401470 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-073ebaf9-6b26-4d9c-a998-8c3f1b3bd0c6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:35.416366 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-073ebaf9-6b26-4d9c-a998-8c3f1b3bd0c6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1740 microversion: 2.20 time: 0.389017 Jun 03 10:00:35.440271 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 173/340] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:35 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1740 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:36.030911 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-7f9d9923-eeed-4e97-a2bc-f9c6047b8f87 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:36.032511 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-7f9d9923-eeed-4e97-a2bc-f9c6047b8f87 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:36.046530 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7f9d9923-eeed-4e97-a2bc-f9c6047b8f87 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:36.047385 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7f9d9923-eeed-4e97-a2bc-f9c6047b8f87 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:36.048411 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7f9d9923-eeed-4e97-a2bc-f9c6047b8f87 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:36.049105 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7f9d9923-eeed-4e97-a2bc-f9c6047b8f87 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:36.071134 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-f4e7b462-1d7f-4dbd-af60-3caf9c6d5357 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:36.071860 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-f4e7b462-1d7f-4dbd-af60-3caf9c6d5357 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:36.088191 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f4e7b462-1d7f-4dbd-af60-3caf9c6d5357 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:36.088711 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f4e7b462-1d7f-4dbd-af60-3caf9c6d5357 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:36.090879 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f4e7b462-1d7f-4dbd-af60-3caf9c6d5357 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:36.093097 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f4e7b462-1d7f-4dbd-af60-3caf9c6d5357 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:36.317243 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-7f9d9923-eeed-4e97-a2bc-f9c6047b8f87 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:36.328216 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-7f9d9923-eeed-4e97-a2bc-f9c6047b8f87 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1372 microversion: 2.1 time: 0.299756 Jun 03 10:00:36.329287 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 168/341] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:36 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1372 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:36.436411 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-f4e7b462-1d7f-4dbd-af60-3caf9c6d5357 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:36.440606 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-4ffb7aee-be28-4e28-8978-044b92708e5c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:36.441689 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-4ffb7aee-be28-4e28-8978-044b92708e5c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:36.446171 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-f4e7b462-1d7f-4dbd-af60-3caf9c6d5357 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1703 microversion: 2.1 time: 0.379182 Jun 03 10:00:36.457449 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 174/342] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:36 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1703 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:36.463894 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-d5923be1-752f-4371-a877-5bb604656dbc tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:36.466574 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4ffb7aee-be28-4e28-8978-044b92708e5c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:36.468739 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4ffb7aee-be28-4e28-8978-044b92708e5c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:36.474048 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4ffb7aee-be28-4e28-8978-044b92708e5c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:36.474738 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4ffb7aee-be28-4e28-8978-044b92708e5c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:36.483749 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d5923be1-752f-4371-a877-5bb604656dbc tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:36.484197 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d5923be1-752f-4371-a877-5bb604656dbc tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:36.639101 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-d5923be1-752f-4371-a877-5bb604656dbc tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Going to try to start instance {{(pid=125066) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 03 10:00:36.768458 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-4ffb7aee-be28-4e28-8978-044b92708e5c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:36.778333 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-4ffb7aee-be28-4e28-8978-044b92708e5c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:36.781717 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-4ffb7aee-be28-4e28-8978-044b92708e5c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:36.781935 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-4ffb7aee-be28-4e28-8978-044b92708e5c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1740 microversion: 2.20 time: 0.345915 Jun 03 10:00:36.794738 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 169/343] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:36 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1740 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:36.898665 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-d5923be1-752f-4371-a877-5bb604656dbc tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "POST /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3/action" status: 202 len: 0 microversion: 2.1 time: 0.438184 Jun 03 10:00:36.898665 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 175/344] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jun 3 10:00:36 2022] POST /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 03 10:00:36.907721 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-256ce39f-2829-49db-955e-d03fd506d9d5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:36.908674 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-256ce39f-2829-49db-955e-d03fd506d9d5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:36.919400 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-256ce39f-2829-49db-955e-d03fd506d9d5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:36.920233 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-256ce39f-2829-49db-955e-d03fd506d9d5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:36.921276 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-256ce39f-2829-49db-955e-d03fd506d9d5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:36.921869 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-256ce39f-2829-49db-955e-d03fd506d9d5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:37.232496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-256ce39f-2829-49db-955e-d03fd506d9d5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:37.245960 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-256ce39f-2829-49db-955e-d03fd506d9d5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1712 microversion: 2.1 time: 0.341891 Jun 03 10:00:37.256645 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 170/345] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:36 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1712 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:37.349952 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-d51a72b2-2667-4a81-b8dd-4c318fd2c221 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:37.351274 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-d51a72b2-2667-4a81-b8dd-4c318fd2c221 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:37.367132 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d51a72b2-2667-4a81-b8dd-4c318fd2c221 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:37.370040 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d51a72b2-2667-4a81-b8dd-4c318fd2c221 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:37.371116 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d51a72b2-2667-4a81-b8dd-4c318fd2c221 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:37.373385 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d51a72b2-2667-4a81-b8dd-4c318fd2c221 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:37.747770 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-d51a72b2-2667-4a81-b8dd-4c318fd2c221 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:37.756747 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-d51a72b2-2667-4a81-b8dd-4c318fd2c221 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1372 microversion: 2.1 time: 0.414154 Jun 03 10:00:37.766261 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 176/346] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:37 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1372 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:37.800592 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-f999ff8e-6b5e-4d49-8280-7c1257d37e3d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:37.801198 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-f999ff8e-6b5e-4d49-8280-7c1257d37e3d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:37.809453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f999ff8e-6b5e-4d49-8280-7c1257d37e3d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:37.809923 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f999ff8e-6b5e-4d49-8280-7c1257d37e3d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:37.810701 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f999ff8e-6b5e-4d49-8280-7c1257d37e3d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:37.811188 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f999ff8e-6b5e-4d49-8280-7c1257d37e3d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:38.218556 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-c0d5f556-44c0-4e08-8206-877125608a1b req-36f9a173-705f-4187-9e24-0328f02e93ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5809214c-e01c-4ff2-adbf-097cf27a9846", "name": "network-vif-plugged", "status": "completed", "tag": "fce52c81-17cf-4133-980e-d0dda0f0288a"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:38.227706 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-c0d5f556-44c0-4e08-8206-877125608a1b req-36f9a173-705f-4187-9e24-0328f02e93ff service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:38.228154 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-c0d5f556-44c0-4e08-8206-877125608a1b req-36f9a173-705f-4187-9e24-0328f02e93ff service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:38.286904 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-c0d5f556-44c0-4e08-8206-877125608a1b req-36f9a173-705f-4187-9e24-0328f02e93ff service nova] Creating event network-vif-plugged:fce52c81-17cf-4133-980e-d0dda0f0288a for instance 5809214c-e01c-4ff2-adbf-097cf27a9846 on hv-cinder-84456 Jun 03 10:00:38.298790 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-c0d5f556-44c0-4e08-8206-877125608a1b req-36f9a173-705f-4187-9e24-0328f02e93ff service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082573 Jun 03 10:00:38.302282 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 177/347] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:00:38.329924 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-58805d46-c1a7-47e7-9ac3-6902e5c54998 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:38.331275 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-58805d46-c1a7-47e7-9ac3-6902e5c54998 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:38.352785 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-58805d46-c1a7-47e7-9ac3-6902e5c54998 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:38.357320 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-58805d46-c1a7-47e7-9ac3-6902e5c54998 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:38.358291 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-58805d46-c1a7-47e7-9ac3-6902e5c54998 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:38.358740 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-58805d46-c1a7-47e7-9ac3-6902e5c54998 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:38.388824 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f999ff8e-6b5e-4d49-8280-7c1257d37e3d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:38.399731 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f999ff8e-6b5e-4d49-8280-7c1257d37e3d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:38.401168 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f999ff8e-6b5e-4d49-8280-7c1257d37e3d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:38.426902 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-f999ff8e-6b5e-4d49-8280-7c1257d37e3d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1740 microversion: 2.20 time: 0.630211 Jun 03 10:00:38.432297 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 171/348] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:37 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1740 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:38.785527 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-9d3cc5b0-f49e-4c21-a42d-36c3ae275e32 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:38.786686 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-9d3cc5b0-f49e-4c21-a42d-36c3ae275e32 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:38.805631 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9d3cc5b0-f49e-4c21-a42d-36c3ae275e32 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:38.807041 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9d3cc5b0-f49e-4c21-a42d-36c3ae275e32 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:38.808101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9d3cc5b0-f49e-4c21-a42d-36c3ae275e32 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:38.808737 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9d3cc5b0-f49e-4c21-a42d-36c3ae275e32 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:38.824755 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-58805d46-c1a7-47e7-9ac3-6902e5c54998 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:38.843753 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-58805d46-c1a7-47e7-9ac3-6902e5c54998 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1712 microversion: 2.1 time: 0.537223 Jun 03 10:00:38.844285 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 178/349] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:38 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1712 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:39.044794 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-9d3cc5b0-f49e-4c21-a42d-36c3ae275e32 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:39.063333 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-9d3cc5b0-f49e-4c21-a42d-36c3ae275e32 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1372 microversion: 2.1 time: 0.284834 Jun 03 10:00:39.063922 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 172/350] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:38 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1372 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:39.446010 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-1a3e87f6-452e-4892-8b25-09193e862371 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:39.446604 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-1a3e87f6-452e-4892-8b25-09193e862371 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:39.456811 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1a3e87f6-452e-4892-8b25-09193e862371 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:39.457264 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1a3e87f6-452e-4892-8b25-09193e862371 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:39.459977 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1a3e87f6-452e-4892-8b25-09193e862371 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:39.460609 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1a3e87f6-452e-4892-8b25-09193e862371 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:39.801323 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-1a3e87f6-452e-4892-8b25-09193e862371 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:39.813773 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-1a3e87f6-452e-4892-8b25-09193e862371 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:39.820911 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-1a3e87f6-452e-4892-8b25-09193e862371 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:39.825120 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-1a3e87f6-452e-4892-8b25-09193e862371 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1740 microversion: 2.20 time: 0.380443 Jun 03 10:00:39.827833 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 179/351] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:39 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1740 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:39.861407 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-caf582d9-3442-406a-8c4b-06cd933beb69 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:39.862900 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-caf582d9-3442-406a-8c4b-06cd933beb69 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:39.870976 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-caf582d9-3442-406a-8c4b-06cd933beb69 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:39.872266 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-caf582d9-3442-406a-8c4b-06cd933beb69 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:39.873300 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-caf582d9-3442-406a-8c4b-06cd933beb69 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:39.874039 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-caf582d9-3442-406a-8c4b-06cd933beb69 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:40.080540 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-26b9a435-dfe1-46f6-a361-f2197c8c955e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:40.081323 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-26b9a435-dfe1-46f6-a361-f2197c8c955e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:40.093632 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-26b9a435-dfe1-46f6-a361-f2197c8c955e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:40.094444 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-26b9a435-dfe1-46f6-a361-f2197c8c955e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:40.096756 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-26b9a435-dfe1-46f6-a361-f2197c8c955e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:40.100537 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-26b9a435-dfe1-46f6-a361-f2197c8c955e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:40.194055 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-caf582d9-3442-406a-8c4b-06cd933beb69 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:40.204597 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-caf582d9-3442-406a-8c4b-06cd933beb69 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1716 microversion: 2.1 time: 0.347855 Jun 03 10:00:40.205177 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 173/352] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:39 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1716 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:40.338797 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-26b9a435-dfe1-46f6-a361-f2197c8c955e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:40.351367 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-26b9a435-dfe1-46f6-a361-f2197c8c955e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1372 microversion: 2.1 time: 0.274665 Jun 03 10:00:40.352322 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 180/353] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:40 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1372 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:40.841412 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-85e5d443-b88f-4a6d-b6df-fd7148e6a381 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:40.842310 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-85e5d443-b88f-4a6d-b6df-fd7148e6a381 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:40.848760 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-85e5d443-b88f-4a6d-b6df-fd7148e6a381 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:40.849444 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-85e5d443-b88f-4a6d-b6df-fd7148e6a381 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:40.850409 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-85e5d443-b88f-4a6d-b6df-fd7148e6a381 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:40.851002 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-85e5d443-b88f-4a6d-b6df-fd7148e6a381 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:41.049736 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-85e5d443-b88f-4a6d-b6df-fd7148e6a381 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:41.073684 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-85e5d443-b88f-4a6d-b6df-fd7148e6a381 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:41.075902 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-85e5d443-b88f-4a6d-b6df-fd7148e6a381 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:41.078425 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-85e5d443-b88f-4a6d-b6df-fd7148e6a381 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1740 microversion: 2.20 time: 0.241425 Jun 03 10:00:41.081523 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 174/354] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:40 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1740 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:41.401046 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-ba66ea70-4a7e-469b-b075-53187418f4b4 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:41.402354 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-ba66ea70-4a7e-469b-b075-53187418f4b4 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:41.424173 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ba66ea70-4a7e-469b-b075-53187418f4b4 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:41.425043 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ba66ea70-4a7e-469b-b075-53187418f4b4 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:41.426692 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ba66ea70-4a7e-469b-b075-53187418f4b4 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:41.428398 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ba66ea70-4a7e-469b-b075-53187418f4b4 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:41.752787 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-ba66ea70-4a7e-469b-b075-53187418f4b4 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:41.761153 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-ba66ea70-4a7e-469b-b075-53187418f4b4 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1372 microversion: 2.1 time: 0.365409 Jun 03 10:00:41.762684 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 181/355] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:41 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1372 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:42.097033 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-6fd8de06-79c6-4d97-8c03-541a8825242e tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:42.098390 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-6fd8de06-79c6-4d97-8c03-541a8825242e tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:42.118854 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6fd8de06-79c6-4d97-8c03-541a8825242e tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:42.120027 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6fd8de06-79c6-4d97-8c03-541a8825242e tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:42.120924 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6fd8de06-79c6-4d97-8c03-541a8825242e tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:42.122355 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6fd8de06-79c6-4d97-8c03-541a8825242e tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:42.371909 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-6fd8de06-79c6-4d97-8c03-541a8825242e tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:42.381550 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-6fd8de06-79c6-4d97-8c03-541a8825242e tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:42.387746 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-6fd8de06-79c6-4d97-8c03-541a8825242e tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:42.389968 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-6fd8de06-79c6-4d97-8c03-541a8825242e tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1740 microversion: 2.20 time: 0.296313 Jun 03 10:00:42.391313 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 175/356] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:42 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1740 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:42.781029 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-e467c981-dafd-494c-8bb3-ec03905efc6e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:42.782302 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-e467c981-dafd-494c-8bb3-ec03905efc6e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:42.798700 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e467c981-dafd-494c-8bb3-ec03905efc6e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:42.799628 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e467c981-dafd-494c-8bb3-ec03905efc6e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:42.800578 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e467c981-dafd-494c-8bb3-ec03905efc6e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:42.801182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e467c981-dafd-494c-8bb3-ec03905efc6e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:43.146119 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-e467c981-dafd-494c-8bb3-ec03905efc6e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:43.160129 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-e467c981-dafd-494c-8bb3-ec03905efc6e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1372 microversion: 2.1 time: 0.384385 Jun 03 10:00:43.161512 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 182/357] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:42 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1372 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:43.415000 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-76415f20-c7e1-46c2-a898-8ad7860af4d0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:43.419978 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-76415f20-c7e1-46c2-a898-8ad7860af4d0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:43.439773 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-76415f20-c7e1-46c2-a898-8ad7860af4d0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:43.440564 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-76415f20-c7e1-46c2-a898-8ad7860af4d0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:43.444882 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-76415f20-c7e1-46c2-a898-8ad7860af4d0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:43.447029 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-76415f20-c7e1-46c2-a898-8ad7860af4d0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:43.801634 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-76415f20-c7e1-46c2-a898-8ad7860af4d0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:43.813451 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-76415f20-c7e1-46c2-a898-8ad7860af4d0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:43.816095 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-76415f20-c7e1-46c2-a898-8ad7860af4d0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:43.818021 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-76415f20-c7e1-46c2-a898-8ad7860af4d0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1740 microversion: 2.20 time: 0.411980 Jun 03 10:00:43.819508 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 176/358] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:43 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1740 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:44.182875 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-a791f3a1-e629-478b-a801-8f1e8fe4b068 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:44.185901 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-a791f3a1-e629-478b-a801-8f1e8fe4b068 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:44.193665 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a791f3a1-e629-478b-a801-8f1e8fe4b068 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:44.195765 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a791f3a1-e629-478b-a801-8f1e8fe4b068 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:44.196893 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a791f3a1-e629-478b-a801-8f1e8fe4b068 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:44.197993 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a791f3a1-e629-478b-a801-8f1e8fe4b068 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:44.473778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-a791f3a1-e629-478b-a801-8f1e8fe4b068 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:44.473778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-a791f3a1-e629-478b-a801-8f1e8fe4b068 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1564 microversion: 2.1 time: 0.264075 Jun 03 10:00:44.473778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 183/359] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:44 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1564 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:44.490687 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-96fb7a51-11a4-44e8-9b41-dd06da17ce16 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:44.491297 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-96fb7a51-11a4-44e8-9b41-dd06da17ce16 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:44.499400 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-96fb7a51-11a4-44e8-9b41-dd06da17ce16 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:44.499980 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-96fb7a51-11a4-44e8-9b41-dd06da17ce16 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:44.500849 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-96fb7a51-11a4-44e8-9b41-dd06da17ce16 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:44.501366 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-96fb7a51-11a4-44e8-9b41-dd06da17ce16 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:44.626295 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-96fb7a51-11a4-44e8-9b41-dd06da17ce16 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.139256 Jun 03 10:00:44.627530 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 177/360] 10.222.0.42 () {58 vars in 1274 bytes} [Fri Jun 3 10:00:44 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:00:44.839003 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-8cb3bd99-a179-4a28-bfac-5f558a852cd0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:44.840308 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-8cb3bd99-a179-4a28-bfac-5f558a852cd0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:44.849346 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8cb3bd99-a179-4a28-bfac-5f558a852cd0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:44.850598 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8cb3bd99-a179-4a28-bfac-5f558a852cd0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:44.854452 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8cb3bd99-a179-4a28-bfac-5f558a852cd0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:44.856568 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8cb3bd99-a179-4a28-bfac-5f558a852cd0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:44.861555 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:45.148262 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-8cb3bd99-a179-4a28-bfac-5f558a852cd0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:45.158061 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-8cb3bd99-a179-4a28-bfac-5f558a852cd0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:45.162486 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-8cb3bd99-a179-4a28-bfac-5f558a852cd0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:45.162486 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-8cb3bd99-a179-4a28-bfac-5f558a852cd0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1740 microversion: 2.20 time: 0.327788 Jun 03 10:00:45.162486 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 184/361] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:44 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1740 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:46.185406 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-3ba1dd6d-484f-44f1-9742-ef74b5771f30 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:46.188124 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-3ba1dd6d-484f-44f1-9742-ef74b5771f30 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:46.210091 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3ba1dd6d-484f-44f1-9742-ef74b5771f30 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:46.211873 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3ba1dd6d-484f-44f1-9742-ef74b5771f30 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:46.218042 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3ba1dd6d-484f-44f1-9742-ef74b5771f30 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:46.221302 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3ba1dd6d-484f-44f1-9742-ef74b5771f30 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:46.925501 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-3ba1dd6d-484f-44f1-9742-ef74b5771f30 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:46.938245 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-3ba1dd6d-484f-44f1-9742-ef74b5771f30 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:46.940283 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-3ba1dd6d-484f-44f1-9742-ef74b5771f30 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:46.946494 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-3ba1dd6d-484f-44f1-9742-ef74b5771f30 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1740 microversion: 2.20 time: 0.766884 Jun 03 10:00:46.950695 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 178/362] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:46 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1740 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:47.303676 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-a33d408f-9cfe-4a10-be51-a0855d9a5c79 req-2ac4ea1f-0985-49d8-b868-567462fb032f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5809214c-e01c-4ff2-adbf-097cf27a9846", "tag": "fce52c81-17cf-4133-980e-d0dda0f0288a"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:47.307679 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_api:SELECT=78 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:47.338343 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-a33d408f-9cfe-4a10-be51-a0855d9a5c79 req-2ac4ea1f-0985-49d8-b868-567462fb032f service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:47.338796 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-a33d408f-9cfe-4a10-be51-a0855d9a5c79 req-2ac4ea1f-0985-49d8-b868-567462fb032f service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:47.364712 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-a33d408f-9cfe-4a10-be51-a0855d9a5c79 req-2ac4ea1f-0985-49d8-b868-567462fb032f service nova] Creating event network-changed:fce52c81-17cf-4133-980e-d0dda0f0288a for instance 5809214c-e01c-4ff2-adbf-097cf27a9846 on hv-cinder-84456 Jun 03 10:00:47.380087 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-a33d408f-9cfe-4a10-be51-a0855d9a5c79 req-2ac4ea1f-0985-49d8-b868-567462fb032f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080017 Jun 03 10:00:47.380698 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 185/363] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:00:47.971803 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-70e0cc64-b38c-4624-a8f9-d122b1c075e3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:47.973208 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-70e0cc64-b38c-4624-a8f9-d122b1c075e3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:47.994432 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-70e0cc64-b38c-4624-a8f9-d122b1c075e3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:47.995174 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-70e0cc64-b38c-4624-a8f9-d122b1c075e3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:47.996156 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-70e0cc64-b38c-4624-a8f9-d122b1c075e3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:47.998003 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-70e0cc64-b38c-4624-a8f9-d122b1c075e3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:48.477618 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-70e0cc64-b38c-4624-a8f9-d122b1c075e3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:48.499599 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-70e0cc64-b38c-4624-a8f9-d122b1c075e3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:48.506032 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-70e0cc64-b38c-4624-a8f9-d122b1c075e3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:48.512263 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-70e0cc64-b38c-4624-a8f9-d122b1c075e3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1740 microversion: 2.20 time: 0.540505 Jun 03 10:00:48.515721 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 179/364] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:47 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1740 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:49.533189 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-8ae2a746-0143-482c-b0c0-cdaeae3d522e tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:49.534041 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-8ae2a746-0143-482c-b0c0-cdaeae3d522e tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:49.543450 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8ae2a746-0143-482c-b0c0-cdaeae3d522e tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:49.544225 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8ae2a746-0143-482c-b0c0-cdaeae3d522e tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:49.545207 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8ae2a746-0143-482c-b0c0-cdaeae3d522e tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:49.545822 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8ae2a746-0143-482c-b0c0-cdaeae3d522e tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:49.710814 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-8ae2a746-0143-482c-b0c0-cdaeae3d522e tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:49.723039 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-8ae2a746-0143-482c-b0c0-cdaeae3d522e tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:49.725096 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-8ae2a746-0143-482c-b0c0-cdaeae3d522e tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:49.725740 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-8ae2a746-0143-482c-b0c0-cdaeae3d522e tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1740 microversion: 2.20 time: 0.197324 Jun 03 10:00:49.726330 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 186/365] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:49 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:50.749309 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-72ae708a-32a2-499b-9cfd-0828b83c0799 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:50.752464 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-72ae708a-32a2-499b-9cfd-0828b83c0799 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:50.773800 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-72ae708a-32a2-499b-9cfd-0828b83c0799 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:50.775279 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-72ae708a-32a2-499b-9cfd-0828b83c0799 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:50.776332 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-72ae708a-32a2-499b-9cfd-0828b83c0799 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:50.783854 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-72ae708a-32a2-499b-9cfd-0828b83c0799 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:51.123014 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-72ae708a-32a2-499b-9cfd-0828b83c0799 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:51.133339 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-72ae708a-32a2-499b-9cfd-0828b83c0799 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:51.135437 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-72ae708a-32a2-499b-9cfd-0828b83c0799 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:51.136947 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-72ae708a-32a2-499b-9cfd-0828b83c0799 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1740 microversion: 2.20 time: 0.391882 Jun 03 10:00:51.137504 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 180/366] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:50 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1740 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:52.154470 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-deeb9ab9-b4bf-4845-bc16-c0545af885ea tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:52.155056 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-deeb9ab9-b4bf-4845-bc16-c0545af885ea tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:52.161042 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-deeb9ab9-b4bf-4845-bc16-c0545af885ea tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:52.161481 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-deeb9ab9-b4bf-4845-bc16-c0545af885ea tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:52.162251 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-deeb9ab9-b4bf-4845-bc16-c0545af885ea tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:52.162682 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-deeb9ab9-b4bf-4845-bc16-c0545af885ea tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:52.362947 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-deeb9ab9-b4bf-4845-bc16-c0545af885ea tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:52.371994 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-deeb9ab9-b4bf-4845-bc16-c0545af885ea tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:52.373943 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-deeb9ab9-b4bf-4845-bc16-c0545af885ea tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:52.375282 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-deeb9ab9-b4bf-4845-bc16-c0545af885ea tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1740 microversion: 2.20 time: 0.225166 Jun 03 10:00:52.375830 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 187/367] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:52 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1740 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:53.394908 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-f26caace-b52f-4a34-8a01-80b427ece149 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:53.396505 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-f26caace-b52f-4a34-8a01-80b427ece149 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:53.413135 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:53.416945 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f26caace-b52f-4a34-8a01-80b427ece149 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:53.418450 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f26caace-b52f-4a34-8a01-80b427ece149 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:53.420289 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f26caace-b52f-4a34-8a01-80b427ece149 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:53.423196 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f26caace-b52f-4a34-8a01-80b427ece149 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:53.662568 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f26caace-b52f-4a34-8a01-80b427ece149 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:53.666198 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=100 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:53.671389 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f26caace-b52f-4a34-8a01-80b427ece149 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:53.672926 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f26caace-b52f-4a34-8a01-80b427ece149 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:53.674534 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-f26caace-b52f-4a34-8a01-80b427ece149 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1722 microversion: 2.20 time: 0.285083 Jun 03 10:00:53.675269 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 181/368] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:53 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1722 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:54.576445 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-4005a314-487d-4058-8f81-92b3c344bae3 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-144077704", "imageRef": "0d2dd03b-4531-46f3-88da-0380e97b1bd4", "flavorRef": "452", "networks": [{"uuid": "67c024cb-fdda-41b3-a0ad-2b9c4d36578f"}]}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:54.628467 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.network.neutron [None req-4005a314-487d-4058-8f81-92b3c344bae3 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] validate_networks() for [('67c024cb-fdda-41b3-a0ad-2b9c4d36578f', None, None, None, None, None)] {{(pid=125066) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 10:00:54.696037 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-2dcc0bc6-2390-4a55-9914-4e36f862a9dc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:54.696633 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-2dcc0bc6-2390-4a55-9914-4e36f862a9dc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:54.704730 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2dcc0bc6-2390-4a55-9914-4e36f862a9dc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:54.705176 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2dcc0bc6-2390-4a55-9914-4e36f862a9dc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:54.705960 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2dcc0bc6-2390-4a55-9914-4e36f862a9dc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:54.706436 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2dcc0bc6-2390-4a55-9914-4e36f862a9dc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:54.926499 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-2dcc0bc6-2390-4a55-9914-4e36f862a9dc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:54.934722 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-2dcc0bc6-2390-4a55-9914-4e36f862a9dc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:54.936211 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-2dcc0bc6-2390-4a55-9914-4e36f862a9dc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:54.937574 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-2dcc0bc6-2390-4a55-9914-4e36f862a9dc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1722 microversion: 2.20 time: 0.245620 Jun 03 10:00:54.938149 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 182/369] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:54 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:55.052586 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-4005a314-487d-4058-8f81-92b3c344bae3 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Flavor limits 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 10:00:55.053049 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-4005a314-487d-4058-8f81-92b3c344bae3 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Image limits 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 10:00:55.053462 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-4005a314-487d-4058-8f81-92b3c344bae3 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Flavor pref 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 10:00:55.053863 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-4005a314-487d-4058-8f81-92b3c344bae3 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Image pref 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 10:00:55.054281 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-4005a314-487d-4058-8f81-92b3c344bae3 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 10:00:55.065359 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4005a314-487d-4058-8f81-92b3c344bae3 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:55.065930 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4005a314-487d-4058-8f81-92b3c344bae3 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:55.066725 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4005a314-487d-4058-8f81-92b3c344bae3 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:55.067150 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4005a314-487d-4058-8f81-92b3c344bae3 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:55.086916 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-4005a314-487d-4058-8f81-92b3c344bae3 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Getting quotas for project 6a0f8d737269433bb6ce1baf51b8157b. Resources: {'ram', 'instances', 'cores'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:00:55.091594 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-4005a314-487d-4058-8f81-92b3c344bae3 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Getting quotas for user 82621df465a640b28eb955733ceda02f and project 6a0f8d737269433bb6ce1baf51b8157b. Resources: {'ram', 'instances', 'cores'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:00:55.102684 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-4005a314-487d-4058-8f81-92b3c344bae3 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Going to run 1 instances... {{(pid=125066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 10:00:55.105156 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-4005a314-487d-4058-8f81-92b3c344bae3 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: dce70d56-25df-45f6-b6cc-6c97ca1ae107] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2dd03b-4531-46f3-88da-0380e97b1bd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 10:00:55.277210 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-4005a314-487d-4058-8f81-92b3c344bae3 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.704609 Jun 03 10:00:55.278063 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 188/370] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 3 10:00:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 10:00:55.287636 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-d4d80c0e-8f2e-42b0-b062-dbcb3893703e tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:55.288243 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-d4d80c0e-8f2e-42b0-b062-dbcb3893703e tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: dce70d56-25df-45f6-b6cc-6c97ca1ae107] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:55.342601 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-d4d80c0e-8f2e-42b0-b062-dbcb3893703e tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:55.349276 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-d4d80c0e-8f2e-42b0-b062-dbcb3893703e tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107" status: 200 len: 1218 microversion: 2.1 time: 0.065396 Jun 03 10:00:55.349849 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 183/371] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:55 2022] GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:55.529104 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-229ce082-d9be-422d-8e30-595fae8186f9 req-7067ea07-e0cc-4f87-89a7-d8791e8d30d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6517823d-711a-4e24-9cdf-27812d522a46", "name": "network-vif-unplugged", "status": "completed", "tag": "a93886de-f812-40e6-81ba-b35e06454a66"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:55.541545 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-229ce082-d9be-422d-8e30-595fae8186f9 req-7067ea07-e0cc-4f87-89a7-d8791e8d30d2 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:55.541545 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-229ce082-d9be-422d-8e30-595fae8186f9 req-7067ea07-e0cc-4f87-89a7-d8791e8d30d2 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:55.549697 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-229ce082-d9be-422d-8e30-595fae8186f9 req-7067ea07-e0cc-4f87-89a7-d8791e8d30d2 service nova] Creating event network-vif-unplugged:a93886de-f812-40e6-81ba-b35e06454a66 for instance 6517823d-711a-4e24-9cdf-27812d522a46 on hv-cinder-84456 Jun 03 10:00:55.554776 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-229ce082-d9be-422d-8e30-595fae8186f9 req-7067ea07-e0cc-4f87-89a7-d8791e8d30d2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029394 Jun 03 10:00:55.555448 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 189/372] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:00:55.957299 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-a8faf927-19ae-452c-9ce5-9c7c7870e941 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:55.957859 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-a8faf927-19ae-452c-9ce5-9c7c7870e941 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:55.965945 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a8faf927-19ae-452c-9ce5-9c7c7870e941 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:55.966448 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a8faf927-19ae-452c-9ce5-9c7c7870e941 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:55.967208 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a8faf927-19ae-452c-9ce5-9c7c7870e941 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:55.967632 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a8faf927-19ae-452c-9ce5-9c7c7870e941 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:56.004033 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-1e3e47bb-3306-4f9d-b718-34ad6d05190d tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1734057995", "imageRef": "0d2dd03b-4531-46f3-88da-0380e97b1bd4", "flavorRef": "452"}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:56.061685 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.network.neutron [None req-1e3e47bb-3306-4f9d-b718-34ad6d05190d tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] validate_networks() for None {{(pid=125066) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 10:00:56.204077 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-a8faf927-19ae-452c-9ce5-9c7c7870e941 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:56.216009 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-a8faf927-19ae-452c-9ce5-9c7c7870e941 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:56.217695 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-a8faf927-19ae-452c-9ce5-9c7c7870e941 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:56.219316 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-a8faf927-19ae-452c-9ce5-9c7c7870e941 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1725 microversion: 2.20 time: 0.266451 Jun 03 10:00:56.230372 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 184/373] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:55 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1725 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:56.237195 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-97942e8b-50b5-4f03-a38a-7bb7e1af816d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30bc81b5-b17a-423c-beaa-1e02a5021841"}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:56.238343 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-97942e8b-50b5-4f03-a38a-7bb7e1af816d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:56.245048 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-97942e8b-50b5-4f03-a38a-7bb7e1af816d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:56.245434 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-97942e8b-50b5-4f03-a38a-7bb7e1af816d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:56.246320 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-97942e8b-50b5-4f03-a38a-7bb7e1af816d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:56.246643 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-97942e8b-50b5-4f03-a38a-7bb7e1af816d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:56.374887 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-1e3e47bb-3306-4f9d-b718-34ad6d05190d tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Flavor limits 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 10:00:56.375310 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-1e3e47bb-3306-4f9d-b718-34ad6d05190d tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Image limits 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 10:00:56.375946 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-1e3e47bb-3306-4f9d-b718-34ad6d05190d tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Flavor pref 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 10:00:56.376412 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-1e3e47bb-3306-4f9d-b718-34ad6d05190d tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Image pref 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 10:00:56.376838 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-1e3e47bb-3306-4f9d-b718-34ad6d05190d tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 10:00:56.385684 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1e3e47bb-3306-4f9d-b718-34ad6d05190d tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:56.386413 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1e3e47bb-3306-4f9d-b718-34ad6d05190d tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:56.387208 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1e3e47bb-3306-4f9d-b718-34ad6d05190d tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:56.387674 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1e3e47bb-3306-4f9d-b718-34ad6d05190d tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:56.404216 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-1e3e47bb-3306-4f9d-b718-34ad6d05190d tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Getting quotas for project 244fa4e99f7348629c9b5506f21cf21e. Resources: {'ram', 'instances', 'cores'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:00:56.408187 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-1e3e47bb-3306-4f9d-b718-34ad6d05190d tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Getting quotas for user f6830a0ff301407a89c88429241b2379 and project 244fa4e99f7348629c9b5506f21cf21e. Resources: {'ram', 'instances', 'cores'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:00:56.419576 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-1e3e47bb-3306-4f9d-b718-34ad6d05190d tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Going to run 1 instances... {{(pid=125066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 10:00:56.422012 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-1e3e47bb-3306-4f9d-b718-34ad6d05190d tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] [instance: 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2dd03b-4531-46f3-88da-0380e97b1bd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 10:00:56.559911 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-1e3e47bb-3306-4f9d-b718-34ad6d05190d tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.559885 Jun 03 10:00:56.560603 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 190/374] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 3 10:00:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 10:00:56.569082 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-444637fa-c69f-4ded-b759-eee3564b8b1b tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:56.570098 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-444637fa-c69f-4ded-b759-eee3564b8b1b tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: dce70d56-25df-45f6-b6cc-6c97ca1ae107] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:56.633049 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-444637fa-c69f-4ded-b759-eee3564b8b1b tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:56.637019 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-444637fa-c69f-4ded-b759-eee3564b8b1b tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107" status: 200 len: 1218 microversion: 2.1 time: 0.074089 Jun 03 10:00:56.637586 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 191/375] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:56 2022] GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:56.642414 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-87a946c2-ec34-459b-9a4f-ce1addca1b1e tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:56.643051 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-87a946c2-ec34-459b-9a4f-ce1addca1b1e tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] [instance: 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:56.696970 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-87a946c2-ec34-459b-9a4f-ce1addca1b1e tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6830a0ff301407a89c88429241b2379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244fa4e99f7348629c9b5506f21cf21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:56.703668 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-87a946c2-ec34-459b-9a4f-ce1addca1b1e tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] 10.222.0.42 "GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44" status: 200 len: 1215 microversion: 2.1 time: 0.064745 Jun 03 10:00:56.704229 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 192/376] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:56 2022] GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 => generated 1215 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:57.641769 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-97942e8b-50b5-4f03-a38a-7bb7e1af816d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "POST /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.407967 Jun 03 10:00:57.644508 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 185/377] 10.222.0.42 () {62 vars in 1363 bytes} [Fri Jun 3 10:00:56 2022] POST /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46/os-volume_attachments => generated 188 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 10:00:57.654195 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-0a3c47f9-7fa1-41a0-9a7b-ba28fed75b2f tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:57.654803 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-0a3c47f9-7fa1-41a0-9a7b-ba28fed75b2f tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: dce70d56-25df-45f6-b6cc-6c97ca1ae107] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:57.664721 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0a3c47f9-7fa1-41a0-9a7b-ba28fed75b2f tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:57.665175 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0a3c47f9-7fa1-41a0-9a7b-ba28fed75b2f tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:57.666588 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0a3c47f9-7fa1-41a0-9a7b-ba28fed75b2f tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:57.667064 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0a3c47f9-7fa1-41a0-9a7b-ba28fed75b2f tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:57.723325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-a35c4d7e-aacc-4076-b5ec-e535bee90c8d tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:57.724277 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-a35c4d7e-aacc-4076-b5ec-e535bee90c8d tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] [instance: 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:57.745641 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-0a3c47f9-7fa1-41a0-9a7b-ba28fed75b2f tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:57.755531 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-0a3c47f9-7fa1-41a0-9a7b-ba28fed75b2f tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107" status: 200 len: 1270 microversion: 2.1 time: 0.105627 Jun 03 10:00:57.759270 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 193/378] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:57 2022] GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107 => generated 1270 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:57.790392 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-a35c4d7e-aacc-4076-b5ec-e535bee90c8d tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6830a0ff301407a89c88429241b2379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244fa4e99f7348629c9b5506f21cf21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:57.798188 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-a35c4d7e-aacc-4076-b5ec-e535bee90c8d tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] 10.222.0.42 "GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44" status: 200 len: 1215 microversion: 2.1 time: 0.081285 Jun 03 10:00:57.799154 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 186/379] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:57 2022] GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 => generated 1215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:57.831538 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-f0d47e81-b213-4f24-a82a-9153ca672833 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:57.832005 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-f0d47e81-b213-4f24-a82a-9153ca672833 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:57.838038 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f0d47e81-b213-4f24-a82a-9153ca672833 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:57.838486 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f0d47e81-b213-4f24-a82a-9153ca672833 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:57.839244 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f0d47e81-b213-4f24-a82a-9153ca672833 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:57.839686 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f0d47e81-b213-4f24-a82a-9153ca672833 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:58.230422 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-f0d47e81-b213-4f24-a82a-9153ca672833 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "POST /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46/action" status: 202 len: 0 microversion: 2.20 time: 0.402413 Jun 03 10:00:58.231683 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 194/380] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jun 3 10:00:57 2022] POST /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:00:58.240839 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-f0d2fdb5-f5b6-439a-8925-f7c84922184d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:58.241777 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-f0d2fdb5-f5b6-439a-8925-f7c84922184d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:58.250895 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f0d2fdb5-f5b6-439a-8925-f7c84922184d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:58.251763 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f0d2fdb5-f5b6-439a-8925-f7c84922184d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:58.252749 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f0d2fdb5-f5b6-439a-8925-f7c84922184d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:58.253213 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f0d2fdb5-f5b6-439a-8925-f7c84922184d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:58.545850 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f0d2fdb5-f5b6-439a-8925-f7c84922184d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:58.554606 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f0d2fdb5-f5b6-439a-8925-f7c84922184d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:58.556116 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f0d2fdb5-f5b6-439a-8925-f7c84922184d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:58.557474 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-f0d2fdb5-f5b6-439a-8925-f7c84922184d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1751 microversion: 2.20 time: 0.321785 Jun 03 10:00:58.558577 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 187/381] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:58 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1751 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:58.779519 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-e2d02df9-9086-4288-a10e-5032616eadfd tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:58.789242 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-e2d02df9-9086-4288-a10e-5032616eadfd tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: dce70d56-25df-45f6-b6cc-6c97ca1ae107] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:58.799030 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e2d02df9-9086-4288-a10e-5032616eadfd tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:58.799529 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e2d02df9-9086-4288-a10e-5032616eadfd tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:58.800240 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e2d02df9-9086-4288-a10e-5032616eadfd tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:58.800682 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e2d02df9-9086-4288-a10e-5032616eadfd tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:58.816213 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-c2ff70d0-ee50-4365-bd8d-7000b636d6c8 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:58.822134 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-c2ff70d0-ee50-4365-bd8d-7000b636d6c8 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] [instance: 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:58.831201 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c2ff70d0-ee50-4365-bd8d-7000b636d6c8 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:58.834503 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c2ff70d0-ee50-4365-bd8d-7000b636d6c8 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:58.835493 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c2ff70d0-ee50-4365-bd8d-7000b636d6c8 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:58.837181 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c2ff70d0-ee50-4365-bd8d-7000b636d6c8 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:59.133498 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-e2d02df9-9086-4288-a10e-5032616eadfd tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:59.143841 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-e2d02df9-9086-4288-a10e-5032616eadfd tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107" status: 200 len: 1288 microversion: 2.1 time: 0.371865 Jun 03 10:00:59.145126 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 195/382] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:58 2022] GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107 => generated 1288 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:59.156858 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-c2ff70d0-ee50-4365-bd8d-7000b636d6c8 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6830a0ff301407a89c88429241b2379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244fa4e99f7348629c9b5506f21cf21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:59.173140 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-c2ff70d0-ee50-4365-bd8d-7000b636d6c8 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] 10.222.0.42 "GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44" status: 200 len: 1267 microversion: 2.1 time: 0.360292 Jun 03 10:00:59.173770 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 188/383] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:58 2022] GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 => generated 1267 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:59.582158 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-f1d82c9e-a066-4144-a2ef-65f988499810 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:59.583000 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-f1d82c9e-a066-4144-a2ef-65f988499810 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:59.590470 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f1d82c9e-a066-4144-a2ef-65f988499810 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:59.590991 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f1d82c9e-a066-4144-a2ef-65f988499810 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:59.591999 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f1d82c9e-a066-4144-a2ef-65f988499810 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:59.592592 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f1d82c9e-a066-4144-a2ef-65f988499810 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:59.861519 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-f1d82c9e-a066-4144-a2ef-65f988499810 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:59.870761 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-f1d82c9e-a066-4144-a2ef-65f988499810 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:59.872918 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-f1d82c9e-a066-4144-a2ef-65f988499810 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:59.874177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-f1d82c9e-a066-4144-a2ef-65f988499810 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1751 microversion: 2.20 time: 0.301963 Jun 03 10:00:59.882732 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 196/384] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:59 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1751 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:00.165054 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-6b9d0699-b93b-4580-8319-539e8a176759 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:00.165758 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-6b9d0699-b93b-4580-8319-539e8a176759 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: dce70d56-25df-45f6-b6cc-6c97ca1ae107] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:00.177929 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6b9d0699-b93b-4580-8319-539e8a176759 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:00.178559 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6b9d0699-b93b-4580-8319-539e8a176759 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:00.180767 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6b9d0699-b93b-4580-8319-539e8a176759 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:00.181556 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6b9d0699-b93b-4580-8319-539e8a176759 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:00.193408 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-131da1fb-293e-4686-bdda-14c617eac683 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:00.194296 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-131da1fb-293e-4686-bdda-14c617eac683 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] [instance: 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:00.203221 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-131da1fb-293e-4686-bdda-14c617eac683 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:00.205340 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-131da1fb-293e-4686-bdda-14c617eac683 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:00.207399 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-131da1fb-293e-4686-bdda-14c617eac683 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:00.208367 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-131da1fb-293e-4686-bdda-14c617eac683 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:00.360891 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-131da1fb-293e-4686-bdda-14c617eac683 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6830a0ff301407a89c88429241b2379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244fa4e99f7348629c9b5506f21cf21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:00.377393 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-131da1fb-293e-4686-bdda-14c617eac683 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] 10.222.0.42 "GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44" status: 200 len: 1273 microversion: 2.1 time: 0.188492 Jun 03 10:01:00.378648 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 197/385] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:00 2022] GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 => generated 1273 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:00.485935 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-6b9d0699-b93b-4580-8319-539e8a176759 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:00.493506 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-6b9d0699-b93b-4580-8319-539e8a176759 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107" status: 200 len: 1318 microversion: 2.1 time: 0.336262 Jun 03 10:01:00.494164 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 189/386] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:00 2022] GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107 => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:00.892863 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-7cc7a4ac-7612-4093-b1fe-4ef16dabc6da tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:00.893465 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-7cc7a4ac-7612-4093-b1fe-4ef16dabc6da tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:00.903244 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7cc7a4ac-7612-4093-b1fe-4ef16dabc6da tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:00.903619 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7cc7a4ac-7612-4093-b1fe-4ef16dabc6da tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:00.904576 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7cc7a4ac-7612-4093-b1fe-4ef16dabc6da tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:00.905193 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7cc7a4ac-7612-4093-b1fe-4ef16dabc6da tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:01.192647 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-7cc7a4ac-7612-4093-b1fe-4ef16dabc6da tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:01.274843 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-7cc7a4ac-7612-4093-b1fe-4ef16dabc6da tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:01.274843 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-7cc7a4ac-7612-4093-b1fe-4ef16dabc6da tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:01.274843 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-7cc7a4ac-7612-4093-b1fe-4ef16dabc6da tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1753 microversion: 2.20 time: 0.324446 Jun 03 10:01:01.275231 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 198/387] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:00 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1753 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:01.283306 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-df0a6d9a-4da5-4435-9b27-47a0c291bb2f req-6220dc5f-bbf0-4709-a501-be8f5c308c7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dce70d56-25df-45f6-b6cc-6c97ca1ae107", "tag": "a2d8efb0-adea-4506-ba70-c181d5230749"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:01:01.291662 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-df0a6d9a-4da5-4435-9b27-47a0c291bb2f req-6220dc5f-bbf0-4709-a501-be8f5c308c7b service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:01.292106 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-df0a6d9a-4da5-4435-9b27-47a0c291bb2f req-6220dc5f-bbf0-4709-a501-be8f5c308c7b service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:01.303117 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-df0a6d9a-4da5-4435-9b27-47a0c291bb2f req-6220dc5f-bbf0-4709-a501-be8f5c308c7b service nova] Creating event network-changed:a2d8efb0-adea-4506-ba70-c181d5230749 for instance dce70d56-25df-45f6-b6cc-6c97ca1ae107 on hv-cinder-84456 Jun 03 10:01:01.308290 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-df0a6d9a-4da5-4435-9b27-47a0c291bb2f req-6220dc5f-bbf0-4709-a501-be8f5c308c7b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028809 Jun 03 10:01:01.308891 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 190/388] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:01:01.396012 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-b33317f9-4c2e-4a3c-9502-4ec4463d882f tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:01.396710 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-b33317f9-4c2e-4a3c-9502-4ec4463d882f tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] [instance: 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:01.403131 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b33317f9-4c2e-4a3c-9502-4ec4463d882f tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:01.403681 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b33317f9-4c2e-4a3c-9502-4ec4463d882f tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:01.404518 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b33317f9-4c2e-4a3c-9502-4ec4463d882f tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:01.405100 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b33317f9-4c2e-4a3c-9502-4ec4463d882f tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:01.513072 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-03e814d6-a91b-46e4-85a0-31847944978c tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:01.514083 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-03e814d6-a91b-46e4-85a0-31847944978c tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: dce70d56-25df-45f6-b6cc-6c97ca1ae107] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:01.520873 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-03e814d6-a91b-46e4-85a0-31847944978c tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:01.521557 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-03e814d6-a91b-46e4-85a0-31847944978c tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:01.522350 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-03e814d6-a91b-46e4-85a0-31847944978c tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:01.522961 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-03e814d6-a91b-46e4-85a0-31847944978c tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:01.867621 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-b33317f9-4c2e-4a3c-9502-4ec4463d882f tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6830a0ff301407a89c88429241b2379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244fa4e99f7348629c9b5506f21cf21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:01.874105 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-b33317f9-4c2e-4a3c-9502-4ec4463d882f tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] 10.222.0.42 "GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44" status: 200 len: 1315 microversion: 2.1 time: 0.482052 Jun 03 10:01:01.874686 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 199/389] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:01 2022] GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:01.912804 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-03e814d6-a91b-46e4-85a0-31847944978c tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:01.922157 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-03e814d6-a91b-46e4-85a0-31847944978c tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107" status: 200 len: 1318 microversion: 2.1 time: 0.413970 Jun 03 10:01:01.922744 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 191/390] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:01 2022] GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107 => generated 1318 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:02.232185 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-2b3e551d-bcfc-4277-b49e-d7b1b37bdcde tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:02.232793 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-2b3e551d-bcfc-4277-b49e-d7b1b37bdcde tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:02.239777 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2b3e551d-bcfc-4277-b49e-d7b1b37bdcde tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:02.247429 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2b3e551d-bcfc-4277-b49e-d7b1b37bdcde tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:02.247429 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2b3e551d-bcfc-4277-b49e-d7b1b37bdcde tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:02.247429 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2b3e551d-bcfc-4277-b49e-d7b1b37bdcde tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:02.552303 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-2b3e551d-bcfc-4277-b49e-d7b1b37bdcde tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:02.562178 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-2b3e551d-bcfc-4277-b49e-d7b1b37bdcde tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:02.563929 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-2b3e551d-bcfc-4277-b49e-d7b1b37bdcde tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:02.565182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-2b3e551d-bcfc-4277-b49e-d7b1b37bdcde tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1753 microversion: 2.20 time: 0.337163 Jun 03 10:01:02.566273 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 200/391] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:02 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1753 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:02.892143 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-06a7566c-37ff-49bc-b9fd-f84f07174449 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:02.893283 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-06a7566c-37ff-49bc-b9fd-f84f07174449 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] [instance: 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:02.901224 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-06a7566c-37ff-49bc-b9fd-f84f07174449 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:02.902188 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-06a7566c-37ff-49bc-b9fd-f84f07174449 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:02.902940 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-06a7566c-37ff-49bc-b9fd-f84f07174449 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:02.903654 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-06a7566c-37ff-49bc-b9fd-f84f07174449 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:02.939139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-fb80dfda-2af9-4584-9eea-9362195e5d4c tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:02.940234 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-fb80dfda-2af9-4584-9eea-9362195e5d4c tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: dce70d56-25df-45f6-b6cc-6c97ca1ae107] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:02.947221 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fb80dfda-2af9-4584-9eea-9362195e5d4c tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:02.947922 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fb80dfda-2af9-4584-9eea-9362195e5d4c tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:02.951429 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fb80dfda-2af9-4584-9eea-9362195e5d4c tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:02.951880 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fb80dfda-2af9-4584-9eea-9362195e5d4c tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:03.175090 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-06a7566c-37ff-49bc-b9fd-f84f07174449 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6830a0ff301407a89c88429241b2379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244fa4e99f7348629c9b5506f21cf21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:03.188611 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-06a7566c-37ff-49bc-b9fd-f84f07174449 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] 10.222.0.42 "GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44" status: 200 len: 1315 microversion: 2.1 time: 0.299031 Jun 03 10:01:03.198308 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 192/392] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:02 2022] GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:03.206266 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-fb80dfda-2af9-4584-9eea-9362195e5d4c tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:03.218228 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-fb80dfda-2af9-4584-9eea-9362195e5d4c tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107" status: 200 len: 1318 microversion: 2.1 time: 0.282680 Jun 03 10:01:03.219487 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 201/393] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:02 2022] GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107 => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:03.322142 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-d5de272d-189b-44ce-8880-92ed5a746391 req-59307dc7-77dc-4e8f-b90b-8b940af293f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44", "tag": "46e03855-8185-4b67-b1b5-b1b93f5e6873"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:01:03.330236 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-d5de272d-189b-44ce-8880-92ed5a746391 req-59307dc7-77dc-4e8f-b90b-8b940af293f2 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:03.330711 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-d5de272d-189b-44ce-8880-92ed5a746391 req-59307dc7-77dc-4e8f-b90b-8b940af293f2 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:03.341778 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-d5de272d-189b-44ce-8880-92ed5a746391 req-59307dc7-77dc-4e8f-b90b-8b940af293f2 service nova] Creating event network-changed:46e03855-8185-4b67-b1b5-b1b93f5e6873 for instance 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 on hv-cinder-84456 Jun 03 10:01:03.347194 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-d5de272d-189b-44ce-8880-92ed5a746391 req-59307dc7-77dc-4e8f-b90b-8b940af293f2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028697 Jun 03 10:01:03.347774 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 193/394] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:01:03.584106 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-41272306-992e-4407-ae38-45fc041434e0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:03.584638 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-41272306-992e-4407-ae38-45fc041434e0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:03.591145 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-41272306-992e-4407-ae38-45fc041434e0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:03.591592 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-41272306-992e-4407-ae38-45fc041434e0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:03.592343 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-41272306-992e-4407-ae38-45fc041434e0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:03.592774 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-41272306-992e-4407-ae38-45fc041434e0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:03.732256 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-41272306-992e-4407-ae38-45fc041434e0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:03.741603 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-41272306-992e-4407-ae38-45fc041434e0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:03.743178 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-41272306-992e-4407-ae38-45fc041434e0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:03.744583 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-41272306-992e-4407-ae38-45fc041434e0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1753 microversion: 2.20 time: 0.164375 Jun 03 10:01:03.745148 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 202/395] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:03 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:04.206107 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-1b5c8e7f-33ac-4490-93d3-78033bff4b53 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:04.211184 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-1b5c8e7f-33ac-4490-93d3-78033bff4b53 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] [instance: 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:04.215637 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1b5c8e7f-33ac-4490-93d3-78033bff4b53 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:04.216094 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1b5c8e7f-33ac-4490-93d3-78033bff4b53 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:04.216995 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1b5c8e7f-33ac-4490-93d3-78033bff4b53 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:04.217621 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1b5c8e7f-33ac-4490-93d3-78033bff4b53 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:04.241060 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-31059d98-f624-444a-99b1-f5ad3591d38e tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:04.242950 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-31059d98-f624-444a-99b1-f5ad3591d38e tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: dce70d56-25df-45f6-b6cc-6c97ca1ae107] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:04.253640 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-31059d98-f624-444a-99b1-f5ad3591d38e tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:04.254493 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-31059d98-f624-444a-99b1-f5ad3591d38e tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:04.255531 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-31059d98-f624-444a-99b1-f5ad3591d38e tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:04.256224 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-31059d98-f624-444a-99b1-f5ad3591d38e tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:04.846611 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-1b5c8e7f-33ac-4490-93d3-78033bff4b53 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6830a0ff301407a89c88429241b2379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244fa4e99f7348629c9b5506f21cf21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:04.854436 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-1b5c8e7f-33ac-4490-93d3-78033bff4b53 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] 10.222.0.42 "GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44" status: 200 len: 1315 microversion: 2.1 time: 0.653470 Jun 03 10:01:04.867315 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 194/396] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:04 2022] GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 => generated 1315 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:04.872914 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-2ce43da5-0ddf-4e72-a427-e67635ccccec tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:04.873694 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-2ce43da5-0ddf-4e72-a427-e67635ccccec tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:04.881744 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2ce43da5-0ddf-4e72-a427-e67635ccccec tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:04.882487 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2ce43da5-0ddf-4e72-a427-e67635ccccec tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:04.883458 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2ce43da5-0ddf-4e72-a427-e67635ccccec tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:04.885552 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2ce43da5-0ddf-4e72-a427-e67635ccccec tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:04.960694 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-31059d98-f624-444a-99b1-f5ad3591d38e tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:04.976716 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-31059d98-f624-444a-99b1-f5ad3591d38e tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107" status: 200 len: 1318 microversion: 2.1 time: 0.744150 Jun 03 10:01:04.977667 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 203/397] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:04 2022] GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107 => generated 1318 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:05.227122 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-2ce43da5-0ddf-4e72-a427-e67635ccccec tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:05.240510 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-2ce43da5-0ddf-4e72-a427-e67635ccccec tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:05.241183 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-2ce43da5-0ddf-4e72-a427-e67635ccccec tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:05.255040 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-2ce43da5-0ddf-4e72-a427-e67635ccccec tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1809 microversion: 2.20 time: 0.374044 Jun 03 10:01:05.255040 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 195/398] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:04 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1809 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:05.883626 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-a35e083f-440d-404d-bbbd-596f7a502d26 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:05.884233 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-a35e083f-440d-404d-bbbd-596f7a502d26 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] [instance: 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:05.892544 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a35e083f-440d-404d-bbbd-596f7a502d26 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:05.893219 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a35e083f-440d-404d-bbbd-596f7a502d26 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:05.894168 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a35e083f-440d-404d-bbbd-596f7a502d26 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:05.894784 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a35e083f-440d-404d-bbbd-596f7a502d26 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:05.916088 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:05.998934 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-6a6e43c9-d551-4621-9dbb-3c7a8ba0c3ba tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:06.004605 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-6a6e43c9-d551-4621-9dbb-3c7a8ba0c3ba tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: dce70d56-25df-45f6-b6cc-6c97ca1ae107] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:06.013305 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6a6e43c9-d551-4621-9dbb-3c7a8ba0c3ba tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:06.019376 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6a6e43c9-d551-4621-9dbb-3c7a8ba0c3ba tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:06.019376 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6a6e43c9-d551-4621-9dbb-3c7a8ba0c3ba tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:06.019376 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6a6e43c9-d551-4621-9dbb-3c7a8ba0c3ba tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:06.167611 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-a35e083f-440d-404d-bbbd-596f7a502d26 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6830a0ff301407a89c88429241b2379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244fa4e99f7348629c9b5506f21cf21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:06.182485 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-a35e083f-440d-404d-bbbd-596f7a502d26 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] 10.222.0.42 "GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44" status: 200 len: 1315 microversion: 2.1 time: 0.302493 Jun 03 10:01:06.183640 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 204/399] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:05 2022] GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:06.224176 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-6a6e43c9-d551-4621-9dbb-3c7a8ba0c3ba tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:06.233724 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-6a6e43c9-d551-4621-9dbb-3c7a8ba0c3ba tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107" status: 200 len: 1318 microversion: 2.1 time: 0.240337 Jun 03 10:01:06.234467 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 196/400] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:05 2022] GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:06.262839 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-c6317e8d-0f95-43fb-88b1-726dad33e482 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:06.263662 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-c6317e8d-0f95-43fb-88b1-726dad33e482 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:06.276066 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c6317e8d-0f95-43fb-88b1-726dad33e482 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:06.276528 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c6317e8d-0f95-43fb-88b1-726dad33e482 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:06.278413 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c6317e8d-0f95-43fb-88b1-726dad33e482 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:06.279497 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c6317e8d-0f95-43fb-88b1-726dad33e482 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:06.394946 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell0:SELECT=4 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:06.513224 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-c6317e8d-0f95-43fb-88b1-726dad33e482 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:06.524256 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-c6317e8d-0f95-43fb-88b1-726dad33e482 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:06.530003 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-c6317e8d-0f95-43fb-88b1-726dad33e482 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:06.530003 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-c6317e8d-0f95-43fb-88b1-726dad33e482 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1809 microversion: 2.20 time: 0.269255 Jun 03 10:01:06.530003 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 205/401] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:06 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1809 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:07.203455 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-c27c4c14-b81b-441f-b6d3-b79e382bdcbb tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:07.204091 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-c27c4c14-b81b-441f-b6d3-b79e382bdcbb tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] [instance: 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:07.220611 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c27c4c14-b81b-441f-b6d3-b79e382bdcbb tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:07.220611 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c27c4c14-b81b-441f-b6d3-b79e382bdcbb tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:07.220937 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c27c4c14-b81b-441f-b6d3-b79e382bdcbb tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:07.224758 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c27c4c14-b81b-441f-b6d3-b79e382bdcbb tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:07.256627 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-55613a40-e079-4ce1-8e36-6394e0a76798 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:07.260410 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-55613a40-e079-4ce1-8e36-6394e0a76798 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: dce70d56-25df-45f6-b6cc-6c97ca1ae107] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:07.274939 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell0:SELECT=16 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:07.277981 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-55613a40-e079-4ce1-8e36-6394e0a76798 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:07.278591 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-55613a40-e079-4ce1-8e36-6394e0a76798 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:07.279590 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-55613a40-e079-4ce1-8e36-6394e0a76798 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:07.280437 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-55613a40-e079-4ce1-8e36-6394e0a76798 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:07.482617 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-c27c4c14-b81b-441f-b6d3-b79e382bdcbb tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6830a0ff301407a89c88429241b2379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244fa4e99f7348629c9b5506f21cf21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:07.530290 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-c27c4c14-b81b-441f-b6d3-b79e382bdcbb tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] 10.222.0.42 "GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44" status: 200 len: 1315 microversion: 2.1 time: 0.331245 Jun 03 10:01:07.547465 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 197/402] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:07 2022] GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:07.569723 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-0bcc09d3-7ba8-4cd2-b7e1-dd0f136e0b60 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:07.573606 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-0bcc09d3-7ba8-4cd2-b7e1-dd0f136e0b60 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:07.596640 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0bcc09d3-7ba8-4cd2-b7e1-dd0f136e0b60 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:07.610579 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0bcc09d3-7ba8-4cd2-b7e1-dd0f136e0b60 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:07.613014 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0bcc09d3-7ba8-4cd2-b7e1-dd0f136e0b60 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:07.614913 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0bcc09d3-7ba8-4cd2-b7e1-dd0f136e0b60 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:07.681569 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-55613a40-e079-4ce1-8e36-6394e0a76798 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:07.702996 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-55613a40-e079-4ce1-8e36-6394e0a76798 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107" status: 200 len: 1318 microversion: 2.1 time: 0.453192 Jun 03 10:01:07.706676 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 206/403] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:07 2022] GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107 => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:07.797401 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell0:SELECT=4 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:08.012037 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-0bcc09d3-7ba8-4cd2-b7e1-dd0f136e0b60 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:08.031344 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-0bcc09d3-7ba8-4cd2-b7e1-dd0f136e0b60 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:08.033496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-0bcc09d3-7ba8-4cd2-b7e1-dd0f136e0b60 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:08.034987 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-0bcc09d3-7ba8-4cd2-b7e1-dd0f136e0b60 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1809 microversion: 2.20 time: 0.486267 Jun 03 10:01:08.035842 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 198/404] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:07 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1809 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:08.096909 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-576b55d4-0e56-4e50-95e4-461a7d3dbdad req-c3dc7c71-5b9e-4732-9a56-ffe2c471659a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dce70d56-25df-45f6-b6cc-6c97ca1ae107", "name": "network-vif-plugged", "status": "completed", "tag": "a2d8efb0-adea-4506-ba70-c181d5230749"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:01:08.115191 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-576b55d4-0e56-4e50-95e4-461a7d3dbdad req-c3dc7c71-5b9e-4732-9a56-ffe2c471659a service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:08.117382 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-576b55d4-0e56-4e50-95e4-461a7d3dbdad req-c3dc7c71-5b9e-4732-9a56-ffe2c471659a service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:08.152415 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-576b55d4-0e56-4e50-95e4-461a7d3dbdad req-c3dc7c71-5b9e-4732-9a56-ffe2c471659a service nova] Creating event network-vif-plugged:a2d8efb0-adea-4506-ba70-c181d5230749 for instance dce70d56-25df-45f6-b6cc-6c97ca1ae107 on hv-cinder-84456 Jun 03 10:01:08.178907 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-576b55d4-0e56-4e50-95e4-461a7d3dbdad req-c3dc7c71-5b9e-4732-9a56-ffe2c471659a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085561 Jun 03 10:01:08.182117 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 207/405] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:01:08.556098 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-23ec2d1d-2f19-4987-bb9f-ea51ddde96bb tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:08.556805 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-23ec2d1d-2f19-4987-bb9f-ea51ddde96bb tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] [instance: 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:08.573954 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-23ec2d1d-2f19-4987-bb9f-ea51ddde96bb tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:08.573954 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-23ec2d1d-2f19-4987-bb9f-ea51ddde96bb tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:08.573954 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-23ec2d1d-2f19-4987-bb9f-ea51ddde96bb tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:08.573954 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-23ec2d1d-2f19-4987-bb9f-ea51ddde96bb tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:08.585049 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:08.739854 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-d3e5628e-f36c-4d36-ac8b-971e00661618 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:08.742497 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-d3e5628e-f36c-4d36-ac8b-971e00661618 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: dce70d56-25df-45f6-b6cc-6c97ca1ae107] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:08.751057 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d3e5628e-f36c-4d36-ac8b-971e00661618 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:08.751786 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d3e5628e-f36c-4d36-ac8b-971e00661618 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:08.752917 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d3e5628e-f36c-4d36-ac8b-971e00661618 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:08.753542 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d3e5628e-f36c-4d36-ac8b-971e00661618 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:09.154678 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-23ec2d1d-2f19-4987-bb9f-ea51ddde96bb tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6830a0ff301407a89c88429241b2379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244fa4e99f7348629c9b5506f21cf21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:09.165694 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-23ec2d1d-2f19-4987-bb9f-ea51ddde96bb tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] 10.222.0.42 "GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44" status: 200 len: 1315 microversion: 2.1 time: 0.613588 Jun 03 10:01:09.166329 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 199/406] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:08 2022] GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 => generated 1315 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:09.182332 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-475af852-b1bd-4d71-a945-6942dda6f145 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:09.184982 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-475af852-b1bd-4d71-a945-6942dda6f145 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:09.201605 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-d3e5628e-f36c-4d36-ac8b-971e00661618 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:09.203794 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-475af852-b1bd-4d71-a945-6942dda6f145 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:09.205367 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-475af852-b1bd-4d71-a945-6942dda6f145 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:09.207417 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-475af852-b1bd-4d71-a945-6942dda6f145 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:09.208216 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-475af852-b1bd-4d71-a945-6942dda6f145 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:09.214298 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-d3e5628e-f36c-4d36-ac8b-971e00661618 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107" status: 200 len: 1318 microversion: 2.1 time: 0.486677 Jun 03 10:01:09.225244 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 208/407] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:08 2022] GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107 => generated 1318 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:09.447928 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-475af852-b1bd-4d71-a945-6942dda6f145 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:09.460544 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-475af852-b1bd-4d71-a945-6942dda6f145 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:09.462536 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-475af852-b1bd-4d71-a945-6942dda6f145 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:09.464498 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-475af852-b1bd-4d71-a945-6942dda6f145 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1809 microversion: 2.20 time: 0.294578 Jun 03 10:01:09.465322 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 200/408] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:09 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1809 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:10.183429 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-bf40ec8a-eb58-46a0-b5ac-d3eabe5599d8 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:10.184048 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-bf40ec8a-eb58-46a0-b5ac-d3eabe5599d8 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] [instance: 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:10.190479 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bf40ec8a-eb58-46a0-b5ac-d3eabe5599d8 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:10.190924 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bf40ec8a-eb58-46a0-b5ac-d3eabe5599d8 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:10.191735 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bf40ec8a-eb58-46a0-b5ac-d3eabe5599d8 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:10.192166 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bf40ec8a-eb58-46a0-b5ac-d3eabe5599d8 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:10.209172 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-63a115e2-3e31-4e35-8694-748787d88051 req-f0ce77f6-f131-4dad-b1cc-9c649ccc99fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44", "name": "network-vif-plugged", "status": "completed", "tag": "46e03855-8185-4b67-b1b5-b1b93f5e6873"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:01:10.222534 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-63a115e2-3e31-4e35-8694-748787d88051 req-f0ce77f6-f131-4dad-b1cc-9c649ccc99fc service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:10.223021 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-63a115e2-3e31-4e35-8694-748787d88051 req-f0ce77f6-f131-4dad-b1cc-9c649ccc99fc service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:10.249154 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-63a115e2-3e31-4e35-8694-748787d88051 req-f0ce77f6-f131-4dad-b1cc-9c649ccc99fc service nova] Creating event network-vif-plugged:46e03855-8185-4b67-b1b5-b1b93f5e6873 for instance 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 on hv-cinder-84456 Jun 03 10:01:10.254528 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-63a115e2-3e31-4e35-8694-748787d88051 req-f0ce77f6-f131-4dad-b1cc-9c649ccc99fc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049399 Jun 03 10:01:10.255343 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 201/409] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:01:10.262974 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-5f4f5c77-f9ed-4e7e-b656-d1e0280ccc6b tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:10.267867 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-5f4f5c77-f9ed-4e7e-b656-d1e0280ccc6b tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: dce70d56-25df-45f6-b6cc-6c97ca1ae107] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:10.274412 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5f4f5c77-f9ed-4e7e-b656-d1e0280ccc6b tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:10.275086 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5f4f5c77-f9ed-4e7e-b656-d1e0280ccc6b tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:10.276002 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5f4f5c77-f9ed-4e7e-b656-d1e0280ccc6b tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:10.276637 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5f4f5c77-f9ed-4e7e-b656-d1e0280ccc6b tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:10.369544 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-bf40ec8a-eb58-46a0-b5ac-d3eabe5599d8 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6830a0ff301407a89c88429241b2379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244fa4e99f7348629c9b5506f21cf21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:10.377131 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-bf40ec8a-eb58-46a0-b5ac-d3eabe5599d8 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] 10.222.0.42 "GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44" status: 200 len: 1315 microversion: 2.1 time: 0.198474 Jun 03 10:01:10.378290 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 209/410] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:10 2022] GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:10.460782 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-5f4f5c77-f9ed-4e7e-b656-d1e0280ccc6b tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:10.469819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-5f4f5c77-f9ed-4e7e-b656-d1e0280ccc6b tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107" status: 200 len: 1318 microversion: 2.1 time: 0.213068 Jun 03 10:01:10.470662 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 202/411] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:10 2022] GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:10.485406 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-edb9b5b7-b0f1-4a8b-b2b7-988cf6874aad tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:10.486047 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-edb9b5b7-b0f1-4a8b-b2b7-988cf6874aad tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:10.492739 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-edb9b5b7-b0f1-4a8b-b2b7-988cf6874aad tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:10.493487 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-edb9b5b7-b0f1-4a8b-b2b7-988cf6874aad tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:10.495132 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-edb9b5b7-b0f1-4a8b-b2b7-988cf6874aad tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:10.495889 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-edb9b5b7-b0f1-4a8b-b2b7-988cf6874aad tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:10.666706 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-edb9b5b7-b0f1-4a8b-b2b7-988cf6874aad tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:10.677141 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-edb9b5b7-b0f1-4a8b-b2b7-988cf6874aad tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:10.678640 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-edb9b5b7-b0f1-4a8b-b2b7-988cf6874aad tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:10.680006 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-edb9b5b7-b0f1-4a8b-b2b7-988cf6874aad tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1809 microversion: 2.20 time: 0.198886 Jun 03 10:01:10.681175 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 210/412] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:10 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:11.395935 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-9be97f11-e352-4f75-bff0-ac486605ec90 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:11.396545 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-9be97f11-e352-4f75-bff0-ac486605ec90 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] [instance: 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:11.406244 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9be97f11-e352-4f75-bff0-ac486605ec90 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:11.406770 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9be97f11-e352-4f75-bff0-ac486605ec90 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:11.407600 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9be97f11-e352-4f75-bff0-ac486605ec90 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:11.408034 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9be97f11-e352-4f75-bff0-ac486605ec90 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:11.488763 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-71c30a9d-0a81-41e9-b64e-34030104788b tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:11.490290 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-71c30a9d-0a81-41e9-b64e-34030104788b tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: dce70d56-25df-45f6-b6cc-6c97ca1ae107] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:11.497429 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-71c30a9d-0a81-41e9-b64e-34030104788b tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:11.497900 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-71c30a9d-0a81-41e9-b64e-34030104788b tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:11.498793 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-71c30a9d-0a81-41e9-b64e-34030104788b tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:11.499231 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-71c30a9d-0a81-41e9-b64e-34030104788b tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:11.562163 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-9be97f11-e352-4f75-bff0-ac486605ec90 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6830a0ff301407a89c88429241b2379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244fa4e99f7348629c9b5506f21cf21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:11.570755 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-9be97f11-e352-4f75-bff0-ac486605ec90 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] 10.222.0.42 "GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44" status: 200 len: 1315 microversion: 2.1 time: 0.179543 Jun 03 10:01:11.580328 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 203/413] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:11 2022] GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:11.661694 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-71c30a9d-0a81-41e9-b64e-34030104788b tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:11.669211 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-71c30a9d-0a81-41e9-b64e-34030104788b tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107" status: 200 len: 1318 microversion: 2.1 time: 0.184515 Jun 03 10:01:11.669784 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 211/414] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:11 2022] GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:11.698873 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-698a3855-ce2d-49dd-9381-ad0180033c82 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:11.699381 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-698a3855-ce2d-49dd-9381-ad0180033c82 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:11.705674 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-698a3855-ce2d-49dd-9381-ad0180033c82 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:11.706155 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-698a3855-ce2d-49dd-9381-ad0180033c82 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:11.706935 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-698a3855-ce2d-49dd-9381-ad0180033c82 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:11.707378 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-698a3855-ce2d-49dd-9381-ad0180033c82 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:11.867273 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-698a3855-ce2d-49dd-9381-ad0180033c82 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:11.876577 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-698a3855-ce2d-49dd-9381-ad0180033c82 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:11.878220 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-698a3855-ce2d-49dd-9381-ad0180033c82 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:11.879372 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-698a3855-ce2d-49dd-9381-ad0180033c82 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1809 microversion: 2.20 time: 0.185277 Jun 03 10:01:11.879925 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 204/415] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:11 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:12.589476 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-a19d9035-3369-46d7-b60f-4301e949f968 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:12.591107 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-a19d9035-3369-46d7-b60f-4301e949f968 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] [instance: 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:12.597530 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a19d9035-3369-46d7-b60f-4301e949f968 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:12.598498 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a19d9035-3369-46d7-b60f-4301e949f968 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:12.599320 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a19d9035-3369-46d7-b60f-4301e949f968 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:12.599815 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a19d9035-3369-46d7-b60f-4301e949f968 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:12.686528 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-586eb0a1-fc5c-40b0-afab-e50ce4097920 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:12.687744 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-586eb0a1-fc5c-40b0-afab-e50ce4097920 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: dce70d56-25df-45f6-b6cc-6c97ca1ae107] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:12.702734 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-586eb0a1-fc5c-40b0-afab-e50ce4097920 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:12.703485 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-586eb0a1-fc5c-40b0-afab-e50ce4097920 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:12.704421 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-586eb0a1-fc5c-40b0-afab-e50ce4097920 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:12.705014 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-586eb0a1-fc5c-40b0-afab-e50ce4097920 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:12.841927 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-a19d9035-3369-46d7-b60f-4301e949f968 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6830a0ff301407a89c88429241b2379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244fa4e99f7348629c9b5506f21cf21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:12.854865 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-a19d9035-3369-46d7-b60f-4301e949f968 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] 10.222.0.42 "GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44" status: 200 len: 1315 microversion: 2.1 time: 0.270381 Jun 03 10:01:12.878120 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 212/416] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:12 2022] GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:12.899578 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-63e3658a-52c6-4b4c-828e-7d23e2aae509 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:12.901060 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-63e3658a-52c6-4b4c-828e-7d23e2aae509 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:12.917138 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-63e3658a-52c6-4b4c-828e-7d23e2aae509 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:12.918089 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-63e3658a-52c6-4b4c-828e-7d23e2aae509 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:12.919044 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-63e3658a-52c6-4b4c-828e-7d23e2aae509 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:12.919628 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-63e3658a-52c6-4b4c-828e-7d23e2aae509 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:13.030616 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-586eb0a1-fc5c-40b0-afab-e50ce4097920 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:13.050266 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-586eb0a1-fc5c-40b0-afab-e50ce4097920 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107" status: 200 len: 1318 microversion: 2.1 time: 0.366617 Jun 03 10:01:13.054061 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 205/417] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:12 2022] GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107 => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:13.180812 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-63e3658a-52c6-4b4c-828e-7d23e2aae509 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:13.200354 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-63e3658a-52c6-4b4c-828e-7d23e2aae509 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:13.200354 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-63e3658a-52c6-4b4c-828e-7d23e2aae509 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:13.200354 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-63e3658a-52c6-4b4c-828e-7d23e2aae509 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1809 microversion: 2.20 time: 0.302225 Jun 03 10:01:13.201347 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 213/418] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:12 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1809 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:01:13.890315 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-ccb2c902-fddd-4ee6-a0de-8522dd362967 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:13.896362 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-ccb2c902-fddd-4ee6-a0de-8522dd362967 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] [instance: 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:13.908093 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ccb2c902-fddd-4ee6-a0de-8522dd362967 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:13.908597 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ccb2c902-fddd-4ee6-a0de-8522dd362967 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:13.927296 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ccb2c902-fddd-4ee6-a0de-8522dd362967 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:13.929088 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ccb2c902-fddd-4ee6-a0de-8522dd362967 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:14.070590 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-e465219a-151b-4866-b6e3-bcfe885acce5 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:14.071917 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-e465219a-151b-4866-b6e3-bcfe885acce5 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: dce70d56-25df-45f6-b6cc-6c97ca1ae107] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:14.079200 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e465219a-151b-4866-b6e3-bcfe885acce5 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:14.085321 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e465219a-151b-4866-b6e3-bcfe885acce5 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:14.086692 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e465219a-151b-4866-b6e3-bcfe885acce5 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:14.088038 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e465219a-151b-4866-b6e3-bcfe885acce5 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:14.257263 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-ccb2c902-fddd-4ee6-a0de-8522dd362967 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6830a0ff301407a89c88429241b2379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244fa4e99f7348629c9b5506f21cf21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:14.273235 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-ccb2c902-fddd-4ee6-a0de-8522dd362967 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] 10.222.0.42 "GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44" status: 200 len: 1315 microversion: 2.1 time: 0.400952 Jun 03 10:01:14.275930 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 206/419] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:13 2022] GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:14.283624 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-e443ef20-854f-496a-8a96-388b36004d2a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:14.291192 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-e443ef20-854f-496a-8a96-388b36004d2a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:14.315713 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e443ef20-854f-496a-8a96-388b36004d2a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:14.317459 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e443ef20-854f-496a-8a96-388b36004d2a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:14.319063 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e443ef20-854f-496a-8a96-388b36004d2a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:14.321075 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e443ef20-854f-496a-8a96-388b36004d2a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:14.458407 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-e465219a-151b-4866-b6e3-bcfe885acce5 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:14.470682 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-e465219a-151b-4866-b6e3-bcfe885acce5 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107" status: 200 len: 1507 microversion: 2.1 time: 0.405616 Jun 03 10:01:14.474281 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 214/420] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:14 2022] GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107 => generated 1507 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:14.671936 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-e443ef20-854f-496a-8a96-388b36004d2a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:14.684375 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-e443ef20-854f-496a-8a96-388b36004d2a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:14.686326 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-e443ef20-854f-496a-8a96-388b36004d2a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:14.687727 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-e443ef20-854f-496a-8a96-388b36004d2a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1809 microversion: 2.20 time: 0.409729 Jun 03 10:01:14.698782 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 207/421] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:14 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1809 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:15.294219 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-db982116-dda4-475a-ab92-3f9a2ca6df6f tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:15.297285 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-db982116-dda4-475a-ab92-3f9a2ca6df6f tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] [instance: 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:15.305523 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-db982116-dda4-475a-ab92-3f9a2ca6df6f tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:15.312970 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-db982116-dda4-475a-ab92-3f9a2ca6df6f tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:15.318980 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-db982116-dda4-475a-ab92-3f9a2ca6df6f tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:15.321287 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-db982116-dda4-475a-ab92-3f9a2ca6df6f tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:15.604762 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-db982116-dda4-475a-ab92-3f9a2ca6df6f tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6830a0ff301407a89c88429241b2379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244fa4e99f7348629c9b5506f21cf21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:15.630257 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-db982116-dda4-475a-ab92-3f9a2ca6df6f tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] 10.222.0.42 "GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44" status: 200 len: 1315 microversion: 2.1 time: 0.330980 Jun 03 10:01:15.643655 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 215/422] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:15 2022] GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:15.719084 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-061d70ff-554d-482a-9d89-92472b6a253d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:15.719786 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-061d70ff-554d-482a-9d89-92472b6a253d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:15.734272 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-061d70ff-554d-482a-9d89-92472b6a253d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:15.735321 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-061d70ff-554d-482a-9d89-92472b6a253d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:15.737328 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-061d70ff-554d-482a-9d89-92472b6a253d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:15.737977 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-061d70ff-554d-482a-9d89-92472b6a253d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:15.963224 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-061d70ff-554d-482a-9d89-92472b6a253d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:15.976449 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-061d70ff-554d-482a-9d89-92472b6a253d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:15.978973 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-061d70ff-554d-482a-9d89-92472b6a253d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:15.980276 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-061d70ff-554d-482a-9d89-92472b6a253d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1809 microversion: 2.20 time: 0.266784 Jun 03 10:01:15.981338 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 208/423] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:15 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1809 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:16.648352 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-60c0e1a9-9203-46ba-852c-ad24633e6992 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:16.648965 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-60c0e1a9-9203-46ba-852c-ad24633e6992 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] [instance: 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:16.658700 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-60c0e1a9-9203-46ba-852c-ad24633e6992 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:16.667534 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-60c0e1a9-9203-46ba-852c-ad24633e6992 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:16.668532 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-60c0e1a9-9203-46ba-852c-ad24633e6992 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:16.668951 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-60c0e1a9-9203-46ba-852c-ad24633e6992 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:17.000506 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-f0288976-1391-4f20-a380-e94321aff1cd tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:17.001233 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-f0288976-1391-4f20-a380-e94321aff1cd tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:17.007926 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f0288976-1391-4f20-a380-e94321aff1cd tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:17.026576 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f0288976-1391-4f20-a380-e94321aff1cd tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:17.029272 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f0288976-1391-4f20-a380-e94321aff1cd tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:17.029842 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f0288976-1391-4f20-a380-e94321aff1cd tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:17.129271 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-60c0e1a9-9203-46ba-852c-ad24633e6992 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6830a0ff301407a89c88429241b2379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244fa4e99f7348629c9b5506f21cf21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:17.144794 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-60c0e1a9-9203-46ba-852c-ad24633e6992 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] 10.222.0.42 "GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44" status: 200 len: 1315 microversion: 2.1 time: 0.500342 Jun 03 10:01:17.146997 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 216/424] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:16 2022] GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 => generated 1315 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:17.354485 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f0288976-1391-4f20-a380-e94321aff1cd tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:17.370383 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f0288976-1391-4f20-a380-e94321aff1cd tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:17.387663 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f0288976-1391-4f20-a380-e94321aff1cd tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:17.387663 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-f0288976-1391-4f20-a380-e94321aff1cd tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1809 microversion: 2.20 time: 0.383835 Jun 03 10:01:17.389189 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 209/425] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:16 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1809 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:01:18.162544 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-de6dba11-78c1-4521-9895-bcda0c752aae tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:18.163157 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-de6dba11-78c1-4521-9895-bcda0c752aae tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] [instance: 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:18.170211 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-de6dba11-78c1-4521-9895-bcda0c752aae tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:18.170659 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-de6dba11-78c1-4521-9895-bcda0c752aae tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:18.177638 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-de6dba11-78c1-4521-9895-bcda0c752aae tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:18.177638 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-de6dba11-78c1-4521-9895-bcda0c752aae tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:18.404078 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-474001e3-2f5f-4110-bb31-e832e320c9b5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:18.405302 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-de6dba11-78c1-4521-9895-bcda0c752aae tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6830a0ff301407a89c88429241b2379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244fa4e99f7348629c9b5506f21cf21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:18.409078 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-474001e3-2f5f-4110-bb31-e832e320c9b5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:18.417292 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-de6dba11-78c1-4521-9895-bcda0c752aae tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] 10.222.0.42 "GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44" status: 200 len: 1464 microversion: 2.1 time: 0.259239 Jun 03 10:01:18.417915 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 217/426] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:18 2022] GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 => generated 1464 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:18.445345 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-474001e3-2f5f-4110-bb31-e832e320c9b5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:18.445345 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-474001e3-2f5f-4110-bb31-e832e320c9b5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:18.445345 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-474001e3-2f5f-4110-bb31-e832e320c9b5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:18.459257 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-474001e3-2f5f-4110-bb31-e832e320c9b5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:18.480748 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-81c1dc74-cd16-4f57-a169-1c17c4b1c2ff tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:18.481242 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-81c1dc74-cd16-4f57-a169-1c17c4b1c2ff tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] [instance: 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:18.483665 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:18.499934 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-81c1dc74-cd16-4f57-a169-1c17c4b1c2ff tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:18.500595 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-81c1dc74-cd16-4f57-a169-1c17c4b1c2ff tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:18.502505 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-81c1dc74-cd16-4f57-a169-1c17c4b1c2ff tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:18.502955 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-81c1dc74-cd16-4f57-a169-1c17c4b1c2ff tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:18.573045 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-81c1dc74-cd16-4f57-a169-1c17c4b1c2ff tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] [instance: 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44] Going to try to terminate instance {{(pid=125066) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:01:18.816014 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-474001e3-2f5f-4110-bb31-e832e320c9b5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:18.826698 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-474001e3-2f5f-4110-bb31-e832e320c9b5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:18.833501 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-474001e3-2f5f-4110-bb31-e832e320c9b5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:18.834872 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-474001e3-2f5f-4110-bb31-e832e320c9b5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1809 microversion: 2.20 time: 0.438860 Jun 03 10:01:18.839107 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 210/427] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:18 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1809 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:19.047620 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-81c1dc74-cd16-4f57-a169-1c17c4b1c2ff tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44" status: 204 len: 0 microversion: 2.1 time: 0.571595 Jun 03 10:01:19.048220 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 218/428] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 3 10:01:18 2022] DELETE /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 03 10:01:19.060328 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-c4e1fbb3-2917-4c85-926e-474b43a5fdbd tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:19.061276 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-c4e1fbb3-2917-4c85-926e-474b43a5fdbd tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] [instance: 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:19.080989 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c4e1fbb3-2917-4c85-926e-474b43a5fdbd tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:19.083785 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c4e1fbb3-2917-4c85-926e-474b43a5fdbd tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:19.083959 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c4e1fbb3-2917-4c85-926e-474b43a5fdbd tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:19.084404 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c4e1fbb3-2917-4c85-926e-474b43a5fdbd tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:19.443750 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-c4e1fbb3-2917-4c85-926e-474b43a5fdbd tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6830a0ff301407a89c88429241b2379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244fa4e99f7348629c9b5506f21cf21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:19.470976 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-c4e1fbb3-2917-4c85-926e-474b43a5fdbd tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] 10.222.0.42 "GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44" status: 200 len: 1470 microversion: 2.1 time: 0.417886 Jun 03 10:01:19.486032 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 211/429] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:19 2022] GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 => generated 1470 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:19.859785 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-be598a62-8862-4e76-a20c-c3b94dcad66f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:19.862034 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-be598a62-8862-4e76-a20c-c3b94dcad66f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:19.870606 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-be598a62-8862-4e76-a20c-c3b94dcad66f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:19.871272 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-be598a62-8862-4e76-a20c-c3b94dcad66f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:19.872165 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-be598a62-8862-4e76-a20c-c3b94dcad66f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:19.872607 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-be598a62-8862-4e76-a20c-c3b94dcad66f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:20.080698 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-be598a62-8862-4e76-a20c-c3b94dcad66f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:20.092718 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-be598a62-8862-4e76-a20c-c3b94dcad66f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:20.094247 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-be598a62-8862-4e76-a20c-c3b94dcad66f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:20.095436 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-be598a62-8862-4e76-a20c-c3b94dcad66f tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1809 microversion: 2.20 time: 0.241105 Jun 03 10:01:20.097949 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 219/430] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:19 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1809 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:20.487328 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-d5127f18-234f-4501-b203-5d2454787b75 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Action: 'create', calling method: .version_select at 0x7f8d30066c10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1365846056", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmSB5cc61l5uKDo4WbuFdM/15mJJkA6XGvDBGn9LB2SZvN3Ff9wCU9afbO9MNy8kegMoWj1qV5GIZYAEAyhS9MPGRati4AYgcHWxLUoD2f1RFDv9FaxA0OHQnFIKzz4wQ=="}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:01:20.497532 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-da2c1ee8-0fb4-48fc-a571-07b0dd489e05 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:20.500315 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-da2c1ee8-0fb4-48fc-a571-07b0dd489e05 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] [instance: 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:20.501587 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.quota [None req-d5127f18-234f-4501-b203-5d2454787b75 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Getting quotas for project 5476f21b29944eb69e32a2d97b328aed. Resources: {'key_pairs'} {{(pid=125065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:01:20.504157 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-da2c1ee8-0fb4-48fc-a571-07b0dd489e05 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:20.504602 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-da2c1ee8-0fb4-48fc-a571-07b0dd489e05 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:20.505357 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-da2c1ee8-0fb4-48fc-a571-07b0dd489e05 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:20.505466 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.quota [None req-d5127f18-234f-4501-b203-5d2454787b75 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Getting quotas for user 646fecf4405c41a0bc062c6b54fd311c and project 5476f21b29944eb69e32a2d97b328aed. Resources: {'key_pairs'} {{(pid=125065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:01:20.505791 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-da2c1ee8-0fb4-48fc-a571-07b0dd489e05 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:20.509761 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:20.618651 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-d5127f18-234f-4501-b203-5d2454787b75 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.303872 Jun 03 10:01:20.619264 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 212/431] 10.222.0.42 () {60 vars in 1158 bytes} [Fri Jun 3 10:01:20 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:01:20.648063 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-da2c1ee8-0fb4-48fc-a571-07b0dd489e05 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6830a0ff301407a89c88429241b2379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244fa4e99f7348629c9b5506f21cf21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:20.657553 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-da2c1ee8-0fb4-48fc-a571-07b0dd489e05 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] 10.222.0.42 "GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44" status: 200 len: 1470 microversion: 2.1 time: 0.163653 Jun 03 10:01:20.663241 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 220/432] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:20 2022] GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 => generated 1470 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:21.119071 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-e876c15d-6827-44f5-987b-e1b6dd324949 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:21.119071 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-e876c15d-6827-44f5-987b-e1b6dd324949 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:21.124878 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e876c15d-6827-44f5-987b-e1b6dd324949 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:21.125316 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e876c15d-6827-44f5-987b-e1b6dd324949 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:21.126112 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e876c15d-6827-44f5-987b-e1b6dd324949 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:21.126542 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e876c15d-6827-44f5-987b-e1b6dd324949 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:21.312750 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-e876c15d-6827-44f5-987b-e1b6dd324949 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:21.322561 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-e876c15d-6827-44f5-987b-e1b6dd324949 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:21.324012 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-e876c15d-6827-44f5-987b-e1b6dd324949 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:21.325296 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-e876c15d-6827-44f5-987b-e1b6dd324949 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1809 microversion: 2.20 time: 0.214693 Jun 03 10:01:21.354150 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 213/433] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:21 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1809 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:21.679292 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-47b7d1a6-be47-4c7c-b0c2-8a4423377a00 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:21.680487 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-47b7d1a6-be47-4c7c-b0c2-8a4423377a00 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] [instance: 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:21.688355 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-47b7d1a6-be47-4c7c-b0c2-8a4423377a00 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:21.692841 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-47b7d1a6-be47-4c7c-b0c2-8a4423377a00 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:21.694157 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-47b7d1a6-be47-4c7c-b0c2-8a4423377a00 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:21.695156 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-47b7d1a6-be47-4c7c-b0c2-8a4423377a00 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:21.898568 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-47b7d1a6-be47-4c7c-b0c2-8a4423377a00 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6830a0ff301407a89c88429241b2379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244fa4e99f7348629c9b5506f21cf21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:21.907365 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-47b7d1a6-be47-4c7c-b0c2-8a4423377a00 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] 10.222.0.42 "GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44" status: 200 len: 1470 microversion: 2.1 time: 0.233602 Jun 03 10:01:21.908142 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 221/434] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:21 2022] GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 => generated 1470 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:22.373847 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-0a9ab760-da73-4066-a19b-a3b7a0b86995 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:22.373847 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-0a9ab760-da73-4066-a19b-a3b7a0b86995 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:22.381428 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0a9ab760-da73-4066-a19b-a3b7a0b86995 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:22.382767 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0a9ab760-da73-4066-a19b-a3b7a0b86995 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:22.383561 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0a9ab760-da73-4066-a19b-a3b7a0b86995 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:22.384536 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0a9ab760-da73-4066-a19b-a3b7a0b86995 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:22.613808 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-0a9ab760-da73-4066-a19b-a3b7a0b86995 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:22.624859 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-0a9ab760-da73-4066-a19b-a3b7a0b86995 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:22.627297 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-0a9ab760-da73-4066-a19b-a3b7a0b86995 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:22.631296 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-0a9ab760-da73-4066-a19b-a3b7a0b86995 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1809 microversion: 2.20 time: 0.280977 Jun 03 10:01:22.631296 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 214/435] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:22 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1809 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:22.932726 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-1e9eebc0-b820-4257-b7e8-f38b7c532de7 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:22.934210 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-1e9eebc0-b820-4257-b7e8-f38b7c532de7 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] [instance: 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:22.942436 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1e9eebc0-b820-4257-b7e8-f38b7c532de7 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:22.942896 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1e9eebc0-b820-4257-b7e8-f38b7c532de7 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:22.943753 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1e9eebc0-b820-4257-b7e8-f38b7c532de7 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:22.944366 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1e9eebc0-b820-4257-b7e8-f38b7c532de7 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:23.097467 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-1e9eebc0-b820-4257-b7e8-f38b7c532de7 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6830a0ff301407a89c88429241b2379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244fa4e99f7348629c9b5506f21cf21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:23.106982 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-1e9eebc0-b820-4257-b7e8-f38b7c532de7 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] 10.222.0.42 "GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44" status: 200 len: 1470 microversion: 2.1 time: 0.185092 Jun 03 10:01:23.112423 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 222/436] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:22 2022] GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 => generated 1470 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:23.648666 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-96f677e2-ab78-470e-8d8f-4fc72ed90737 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:23.653716 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-96f677e2-ab78-470e-8d8f-4fc72ed90737 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:23.658389 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-96f677e2-ab78-470e-8d8f-4fc72ed90737 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:23.658872 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-96f677e2-ab78-470e-8d8f-4fc72ed90737 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:23.660141 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-96f677e2-ab78-470e-8d8f-4fc72ed90737 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:23.660595 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-96f677e2-ab78-470e-8d8f-4fc72ed90737 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:23.846296 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-96f677e2-ab78-470e-8d8f-4fc72ed90737 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:23.855517 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-96f677e2-ab78-470e-8d8f-4fc72ed90737 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:23.862076 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-96f677e2-ab78-470e-8d8f-4fc72ed90737 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:23.862076 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-96f677e2-ab78-470e-8d8f-4fc72ed90737 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1809 microversion: 2.20 time: 0.213528 Jun 03 10:01:23.862076 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 215/437] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:23 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1809 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:24.125153 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-27622d22-b8ee-41fb-9594-b0708680ceb2 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:24.125759 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-27622d22-b8ee-41fb-9594-b0708680ceb2 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] [instance: 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:24.134846 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-27622d22-b8ee-41fb-9594-b0708680ceb2 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:24.139452 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-27622d22-b8ee-41fb-9594-b0708680ceb2 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:24.140277 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-27622d22-b8ee-41fb-9594-b0708680ceb2 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:24.140718 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-27622d22-b8ee-41fb-9594-b0708680ceb2 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:24.283273 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-27622d22-b8ee-41fb-9594-b0708680ceb2 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6830a0ff301407a89c88429241b2379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244fa4e99f7348629c9b5506f21cf21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:24.295488 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-27622d22-b8ee-41fb-9594-b0708680ceb2 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] 10.222.0.42 "GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44" status: 200 len: 1470 microversion: 2.1 time: 0.174282 Jun 03 10:01:24.296145 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 223/438] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:24 2022] GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 => generated 1470 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:24.877190 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-0cf154d4-c828-4be9-b8fa-f1fb355b853d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:24.877770 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-0cf154d4-c828-4be9-b8fa-f1fb355b853d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:24.880289 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=1 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:24.885345 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0cf154d4-c828-4be9-b8fa-f1fb355b853d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:24.886174 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0cf154d4-c828-4be9-b8fa-f1fb355b853d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:24.887014 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0cf154d4-c828-4be9-b8fa-f1fb355b853d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:24.887557 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0cf154d4-c828-4be9-b8fa-f1fb355b853d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:25.276248 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-0cf154d4-c828-4be9-b8fa-f1fb355b853d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:25.312659 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-0aa10d04-058a-4f8b-adcd-2602f6da31b2 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:25.313277 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-0cf154d4-c828-4be9-b8fa-f1fb355b853d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:25.313391 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-0aa10d04-058a-4f8b-adcd-2602f6da31b2 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] [instance: 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:25.314987 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-0cf154d4-c828-4be9-b8fa-f1fb355b853d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:25.316190 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-0cf154d4-c828-4be9-b8fa-f1fb355b853d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1809 microversion: 2.20 time: 0.443113 Jun 03 10:01:25.322778 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 216/439] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:24 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1809 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:25.329546 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0aa10d04-058a-4f8b-adcd-2602f6da31b2 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:25.330106 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0aa10d04-058a-4f8b-adcd-2602f6da31b2 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:25.330895 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0aa10d04-058a-4f8b-adcd-2602f6da31b2 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:25.331337 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0aa10d04-058a-4f8b-adcd-2602f6da31b2 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:25.674651 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-0aa10d04-058a-4f8b-adcd-2602f6da31b2 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6830a0ff301407a89c88429241b2379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244fa4e99f7348629c9b5506f21cf21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:25.686718 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-0aa10d04-058a-4f8b-adcd-2602f6da31b2 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] 10.222.0.42 "GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44" status: 200 len: 1470 microversion: 2.1 time: 0.377798 Jun 03 10:01:25.687952 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 224/440] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:25 2022] GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 => generated 1470 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:25.983263 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-92ae6fc2-a1df-47fb-b566-100cc5ca4bbd req-c9e0cc18-1b30-4a57-9ba8-e980f7d707da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44", "name": "network-vif-deleted", "tag": "46e03855-8185-4b67-b1b5-b1b93f5e6873"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:01:25.993062 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-92ae6fc2-a1df-47fb-b566-100cc5ca4bbd req-c9e0cc18-1b30-4a57-9ba8-e980f7d707da service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:25.994312 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-92ae6fc2-a1df-47fb-b566-100cc5ca4bbd req-c9e0cc18-1b30-4a57-9ba8-e980f7d707da service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:26.006465 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-92ae6fc2-a1df-47fb-b566-100cc5ca4bbd req-c9e0cc18-1b30-4a57-9ba8-e980f7d707da service nova] Creating event network-vif-deleted:46e03855-8185-4b67-b1b5-b1b93f5e6873 for instance 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 on hv-cinder-84456 Jun 03 10:01:26.011885 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-92ae6fc2-a1df-47fb-b566-100cc5ca4bbd req-c9e0cc18-1b30-4a57-9ba8-e980f7d707da service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032836 Jun 03 10:01:26.012551 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 217/441] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:01:26.340395 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-f263ec28-4a43-4b2a-900a-099227fd03fa tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:26.341042 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-f263ec28-4a43-4b2a-900a-099227fd03fa tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:26.347187 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f263ec28-4a43-4b2a-900a-099227fd03fa tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:26.347658 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f263ec28-4a43-4b2a-900a-099227fd03fa tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:26.348700 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f263ec28-4a43-4b2a-900a-099227fd03fa tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:26.349138 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f263ec28-4a43-4b2a-900a-099227fd03fa tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:26.494960 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-f263ec28-4a43-4b2a-900a-099227fd03fa tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:26.503692 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-f263ec28-4a43-4b2a-900a-099227fd03fa tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:26.507745 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-f263ec28-4a43-4b2a-900a-099227fd03fa tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:26.507745 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-f263ec28-4a43-4b2a-900a-099227fd03fa tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1809 microversion: 2.20 time: 0.170482 Jun 03 10:01:26.507745 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 225/442] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:26 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:26.704063 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-77a5ec7e-d6eb-4ad7-9197-62cbc3b88e25 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:26.704752 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-77a5ec7e-d6eb-4ad7-9197-62cbc3b88e25 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] [instance: 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:26.711970 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-77a5ec7e-d6eb-4ad7-9197-62cbc3b88e25 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:26.712442 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-77a5ec7e-d6eb-4ad7-9197-62cbc3b88e25 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:26.713281 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-77a5ec7e-d6eb-4ad7-9197-62cbc3b88e25 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:26.717585 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-77a5ec7e-d6eb-4ad7-9197-62cbc3b88e25 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:26.723815 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=100 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:26.753185 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-77a5ec7e-d6eb-4ad7-9197-62cbc3b88e25 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:26.753627 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-77a5ec7e-d6eb-4ad7-9197-62cbc3b88e25 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:26.754094 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.objects.instance [None req-77a5ec7e-d6eb-4ad7-9197-62cbc3b88e25 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lazy-loading 'fault' on Instance uuid 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 {{(pid=125065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:01:26.802392 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-77a5ec7e-d6eb-4ad7-9197-62cbc3b88e25 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6830a0ff301407a89c88429241b2379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244fa4e99f7348629c9b5506f21cf21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:26.811296 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-77a5ec7e-d6eb-4ad7-9197-62cbc3b88e25 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] 10.222.0.42 "GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44" status: 200 len: 1305 microversion: 2.1 time: 0.111370 Jun 03 10:01:26.811898 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 218/443] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:26 2022] GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 => generated 1305 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:27.525834 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-12dca559-27fa-4fad-b2fe-7bbdb85e6bdf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:27.526453 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-12dca559-27fa-4fad-b2fe-7bbdb85e6bdf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:27.532481 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-12dca559-27fa-4fad-b2fe-7bbdb85e6bdf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:27.532933 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-12dca559-27fa-4fad-b2fe-7bbdb85e6bdf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:27.533689 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-12dca559-27fa-4fad-b2fe-7bbdb85e6bdf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:27.534153 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-12dca559-27fa-4fad-b2fe-7bbdb85e6bdf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:27.667923 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-12dca559-27fa-4fad-b2fe-7bbdb85e6bdf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:27.677517 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-12dca559-27fa-4fad-b2fe-7bbdb85e6bdf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:27.679091 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-12dca559-27fa-4fad-b2fe-7bbdb85e6bdf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:27.680299 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-12dca559-27fa-4fad-b2fe-7bbdb85e6bdf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1809 microversion: 2.20 time: 0.159441 Jun 03 10:01:27.681364 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 226/444] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:27 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:27.828864 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-6a876ff2-3756-44ad-8175-2fee478d9e88 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:27.829496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-6a876ff2-3756-44ad-8175-2fee478d9e88 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] [instance: 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:27.836122 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6a876ff2-3756-44ad-8175-2fee478d9e88 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:27.836565 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6a876ff2-3756-44ad-8175-2fee478d9e88 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:27.837322 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6a876ff2-3756-44ad-8175-2fee478d9e88 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:27.837758 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6a876ff2-3756-44ad-8175-2fee478d9e88 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:27.872276 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6a876ff2-3756-44ad-8175-2fee478d9e88 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:27.872730 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6a876ff2-3756-44ad-8175-2fee478d9e88 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:27.873191 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.objects.instance [None req-6a876ff2-3756-44ad-8175-2fee478d9e88 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lazy-loading 'fault' on Instance uuid 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 {{(pid=125065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:01:27.913829 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-6a876ff2-3756-44ad-8175-2fee478d9e88 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6830a0ff301407a89c88429241b2379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '244fa4e99f7348629c9b5506f21cf21e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:27.920786 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-6a876ff2-3756-44ad-8175-2fee478d9e88 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] 10.222.0.42 "GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44" status: 200 len: 1305 microversion: 2.1 time: 0.095875 Jun 03 10:01:27.922545 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 219/445] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:27 2022] GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 => generated 1305 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:28.668277 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-4f7057f9-0ae4-4d03-9f27-3ff58adb7aed tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:28.668846 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-4f7057f9-0ae4-4d03-9f27-3ff58adb7aed tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:28.675226 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4f7057f9-0ae4-4d03-9f27-3ff58adb7aed tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:28.675755 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4f7057f9-0ae4-4d03-9f27-3ff58adb7aed tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:28.676517 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4f7057f9-0ae4-4d03-9f27-3ff58adb7aed tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:28.676953 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4f7057f9-0ae4-4d03-9f27-3ff58adb7aed tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:28.699743 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-ee52ffa8-eb59-492d-a95f-488b67e462b3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:28.700350 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-ee52ffa8-eb59-492d-a95f-488b67e462b3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:28.706350 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ee52ffa8-eb59-492d-a95f-488b67e462b3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:28.706797 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ee52ffa8-eb59-492d-a95f-488b67e462b3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:28.707559 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ee52ffa8-eb59-492d-a95f-488b67e462b3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:28.708000 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ee52ffa8-eb59-492d-a95f-488b67e462b3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:28.813786 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.objects.instance [None req-4f7057f9-0ae4-4d03-9f27-3ff58adb7aed tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lazy-loading 'services' on Instance uuid 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 {{(pid=125066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:01:28.869293 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-ee52ffa8-eb59-492d-a95f-488b67e462b3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:28.882385 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-ee52ffa8-eb59-492d-a95f-488b67e462b3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:28.884327 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-ee52ffa8-eb59-492d-a95f-488b67e462b3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:28.885580 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-ee52ffa8-eb59-492d-a95f-488b67e462b3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1809 microversion: 2.20 time: 0.190272 Jun 03 10:01:28.887046 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 220/446] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:28 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:01:28.939295 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-a4e64eae-4586-469c-b86f-53642d5f18f9 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:28.939924 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-a4e64eae-4586-469c-b86f-53642d5f18f9 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] [instance: 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:28.946700 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a4e64eae-4586-469c-b86f-53642d5f18f9 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:28.947250 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a4e64eae-4586-469c-b86f-53642d5f18f9 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:28.963663 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a4e64eae-4586-469c-b86f-53642d5f18f9 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:28.963663 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a4e64eae-4586-469c-b86f-53642d5f18f9 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:28.965850 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.wsgi [None req-a4e64eae-4586-469c-b86f-53642d5f18f9 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] HTTP exception thrown: Instance 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 could not be found. Jun 03 10:01:28.968822 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-a4e64eae-4586-469c-b86f-53642d5f18f9 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Request method failure captured: Jun 03 10:01:28.968822 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: request: GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 HTTP/1.1 Jun 03 10:01:28.968822 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept: application/json Jun 03 10:01:28.968822 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept-Encoding: identity Jun 03 10:01:28.968822 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Connection: close Jun 03 10:01:28.968822 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Length: 0 Jun 03 10:01:28.968822 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Type: application/json Jun 03 10:01:28.968822 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Host: 10.222.0.42 Jun 03 10:01:28.968822 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Openstack-System-Scope: None Jun 03 10:01:28.968822 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: User-Agent: python-urllib3/1.26.9 Jun 03 10:01:28.968822 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Auth-Token: gAAAAABimdvV7pBlsUClNHUr4v23BLoIXnOdOZVuYtCyZlkzYbYSvbUZao4jbaEBYiivlNwWtM8u3VS3loTv0xu7qLBoq6ld3_BmZNWjSLK7NSHWipQciqUyc3_oWdoANWAuPpLN09UDIySA0tHMx1uNPq6tVWyMclDM2zm2mv_SwaEKkEqpDTY Jun 03 10:01:28.968822 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Id: None Jun 03 10:01:28.968822 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Name: None Jun 03 10:01:28.968822 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Identity-Status: Confirmed Jun 03 10:01:28.968822 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Is-Admin-Project: True Jun 03 10:01:28.968822 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Id: default Jun 03 10:01:28.968822 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Name: Default Jun 03 10:01:28.968822 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Id: 244fa4e99f7348629c9b5506f21cf21e Jun 03 10:01:28.968822 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Name: tempest-VolumesNegativeTest-620875663 Jun 03 10:01:28.968822 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Role: member,reader Jun 03 10:01:28.968822 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Roles: member,reader Jun 03 10:01:28.970377 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/244fa4e99f7348629c9b5506f21cf21e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/244fa4e99f7348629c9b5506f21cf21e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_244fa4e99f7348629c9b5506f21cf21e", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/244fa4e99f7348629c9b5506f21cf21e"}]}] Jun 03 10:01:28.970377 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant: tempest-VolumesNegativeTest-620875663 Jun 03 10:01:28.970377 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Id: 244fa4e99f7348629c9b5506f21cf21e Jun 03 10:01:28.970377 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Name: tempest-VolumesNegativeTest-620875663 Jun 03 10:01:28.970377 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User: tempest-VolumesNegativeTest-620875663-project Jun 03 10:01:28.970377 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Id: default Jun 03 10:01:28.970377 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Name: Default Jun 03 10:01:28.970377 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Id: f6830a0ff301407a89c88429241b2379 Jun 03 10:01:28.970377 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Name: tempest-VolumesNegativeTest-620875663-project Jun 03 10:01:28.970377 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: method: > Jun 03 10:01:28.970377 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: exception: Instance 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 could not be found. Jun 03 10:01:28.970377 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: action_args: {'id': '2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44'} Jun 03 10:01:28.971453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:01:28.971453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:01:28.971453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:01:28.971453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:01:28.971453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:01:28.971453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:01:28.971453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:01:28.971453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:01:28.971453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:01:28.971453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:01:28.971453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 could not be found. Jun 03 10:01:28.971453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:01:28.971453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:01:28.971453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:01:28.971453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:01:28.971453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:01:28.971453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:01:28.971453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:01:28.971453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:01:28.971453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:01:28.972704 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:01:28.972704 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:01:28.972704 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:01:28.972704 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:01:28.972704 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:01:28.972704 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:01:28.972704 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:01:28.972704 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 could not be found. Jun 03 10:01:28.972704 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:01:28.972704 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:01:28.972704 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:01:28.972704 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:01:28.972704 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:01:28.972704 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:01:28.972704 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:01:28.972704 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:01:28.972704 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 could not be found. Jun 03 10:01:28.972704 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:01:28.973939 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-a4e64eae-4586-469c-b86f-53642d5f18f9 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] Returning 404 to user: Instance 2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 could not be found. {{(pid=125065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:01:28.973939 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-a4e64eae-4586-469c-b86f-53642d5f18f9 tempest-VolumesNegativeTest-620875663 tempest-VolumesNegativeTest-620875663-project] 10.222.0.42 "GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44" status: 404 len: 111 microversion: 2.1 time: 0.036082 Jun 03 10:01:28.973939 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 221/447] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:28 2022] GET /compute/v2.1/servers/2a4a7bbc-d2b4-4e25-8e3e-3a377f4c2f44 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 10:01:29.646557 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-4f7057f9-0ae4-4d03-9f27-3ff58adb7aed tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "DELETE /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3/os-volume_attachments/a306120d-3ddb-424d-b144-d9ee09affbbb" status: 202 len: 0 microversion: 2.1 time: 0.981957 Jun 03 10:01:29.647179 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 227/448] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jun 3 10:01:28 2022] DELETE /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3/os-volume_attachments/a306120d-3ddb-424d-b144-d9ee09affbbb => generated 0 bytes in 984 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:01:29.906876 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-2faf473d-ea1b-4b11-b662-7b4b1359e760 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:29.907530 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-2faf473d-ea1b-4b11-b662-7b4b1359e760 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:29.914045 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2faf473d-ea1b-4b11-b662-7b4b1359e760 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:29.914497 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2faf473d-ea1b-4b11-b662-7b4b1359e760 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:29.915300 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2faf473d-ea1b-4b11-b662-7b4b1359e760 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:29.915725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2faf473d-ea1b-4b11-b662-7b4b1359e760 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:30.058975 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-2faf473d-ea1b-4b11-b662-7b4b1359e760 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:30.067611 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-2faf473d-ea1b-4b11-b662-7b4b1359e760 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:30.069142 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-2faf473d-ea1b-4b11-b662-7b4b1359e760 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:30.070339 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-2faf473d-ea1b-4b11-b662-7b4b1359e760 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1809 microversion: 2.20 time: 0.167536 Jun 03 10:01:30.070891 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 222/449] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:29 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:31.089716 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-034aaa27-b83c-4e6b-9ae7-4e0cc7346c8b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:31.090554 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-034aaa27-b83c-4e6b-9ae7-4e0cc7346c8b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:31.097106 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-034aaa27-b83c-4e6b-9ae7-4e0cc7346c8b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:31.097562 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-034aaa27-b83c-4e6b-9ae7-4e0cc7346c8b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:31.098365 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-034aaa27-b83c-4e6b-9ae7-4e0cc7346c8b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:31.098805 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-034aaa27-b83c-4e6b-9ae7-4e0cc7346c8b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:31.233120 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-034aaa27-b83c-4e6b-9ae7-4e0cc7346c8b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:31.241917 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-034aaa27-b83c-4e6b-9ae7-4e0cc7346c8b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:31.243471 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-034aaa27-b83c-4e6b-9ae7-4e0cc7346c8b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:31.244704 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-034aaa27-b83c-4e6b-9ae7-4e0cc7346c8b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1809 microversion: 2.20 time: 0.159966 Jun 03 10:01:31.245261 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 228/450] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:31 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:32.264589 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-34127767-14b4-419a-89ac-14c48f3e9531 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:32.265162 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-34127767-14b4-419a-89ac-14c48f3e9531 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:32.267105 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell0:SELECT=4 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:32.272062 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-34127767-14b4-419a-89ac-14c48f3e9531 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:32.272520 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-34127767-14b4-419a-89ac-14c48f3e9531 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:32.273289 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-34127767-14b4-419a-89ac-14c48f3e9531 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:32.273732 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-34127767-14b4-419a-89ac-14c48f3e9531 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:32.417907 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-34127767-14b4-419a-89ac-14c48f3e9531 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:32.427881 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-34127767-14b4-419a-89ac-14c48f3e9531 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:32.429412 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-34127767-14b4-419a-89ac-14c48f3e9531 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:32.430773 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-34127767-14b4-419a-89ac-14c48f3e9531 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1809 microversion: 2.20 time: 0.171457 Jun 03 10:01:32.431320 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 223/451] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:32 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:32.869983 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-b88f5ff0-f593-4b8d-ab10-6b39279b3697 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:01:32.876063 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b88f5ff0-f593-4b8d-ab10-6b39279b3697 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:32.876844 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b88f5ff0-f593-4b8d-ab10-6b39279b3697 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:32.899990 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-b88f5ff0-f593-4b8d-ab10-6b39279b3697 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Going to try to stop instance {{(pid=125066) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 03 10:01:33.161953 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-b88f5ff0-f593-4b8d-ab10-6b39279b3697 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "POST /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3/action" status: 202 len: 0 microversion: 2.1 time: 0.294859 Jun 03 10:01:33.162683 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 229/452] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jun 3 10:01:32 2022] POST /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:01:33.170967 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-bf51dc7f-a642-44c3-b87c-c6bc7c2ba8f8 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:33.171593 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-bf51dc7f-a642-44c3-b87c-c6bc7c2ba8f8 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:33.181476 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-bf51dc7f-a642-44c3-b87c-c6bc7c2ba8f8 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:33.182120 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-bf51dc7f-a642-44c3-b87c-c6bc7c2ba8f8 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:33.183080 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-bf51dc7f-a642-44c3-b87c-c6bc7c2ba8f8 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:33.183530 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-bf51dc7f-a642-44c3-b87c-c6bc7c2ba8f8 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:33.319289 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-bf51dc7f-a642-44c3-b87c-c6bc7c2ba8f8 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:33.327290 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-bf51dc7f-a642-44c3-b87c-c6bc7c2ba8f8 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1680 microversion: 2.1 time: 0.160139 Jun 03 10:01:33.328134 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 224/453] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:33 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:33.449243 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-0b787800-fdf0-4051-8300-562ca02e01a5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:33.450294 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-0b787800-fdf0-4051-8300-562ca02e01a5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:33.457690 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0b787800-fdf0-4051-8300-562ca02e01a5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:33.458419 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0b787800-fdf0-4051-8300-562ca02e01a5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:33.459614 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0b787800-fdf0-4051-8300-562ca02e01a5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:33.460065 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0b787800-fdf0-4051-8300-562ca02e01a5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:33.602018 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-0b787800-fdf0-4051-8300-562ca02e01a5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:33.610868 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-0b787800-fdf0-4051-8300-562ca02e01a5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:33.612489 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-0b787800-fdf0-4051-8300-562ca02e01a5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:33.613629 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-0b787800-fdf0-4051-8300-562ca02e01a5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1809 microversion: 2.20 time: 0.168827 Jun 03 10:01:33.614227 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 230/454] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:33 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:33.730872 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-ce30e207-620e-4dcc-9c05-96af9571a7be tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b142ba7a-2b86-4787-a88e-4dc3d25cbf03"}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:01:33.732004 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-ce30e207-620e-4dcc-9c05-96af9571a7be tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:33.738534 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ce30e207-620e-4dcc-9c05-96af9571a7be tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:33.738976 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ce30e207-620e-4dcc-9c05-96af9571a7be tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:33.739902 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ce30e207-620e-4dcc-9c05-96af9571a7be tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:33.740486 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ce30e207-620e-4dcc-9c05-96af9571a7be tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:33.787354 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-fa5dfcc7-8117-4c88-bdc1-8491f0069d0d req-b1fb8d13-b3aa-4ce8-aa43-97b75d22017b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6517823d-711a-4e24-9cdf-27812d522a46", "name": "network-vif-plugged", "status": "completed", "tag": "a93886de-f812-40e6-81ba-b35e06454a66"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:01:33.796794 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-fa5dfcc7-8117-4c88-bdc1-8491f0069d0d req-b1fb8d13-b3aa-4ce8-aa43-97b75d22017b service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:33.797237 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-fa5dfcc7-8117-4c88-bdc1-8491f0069d0d req-b1fb8d13-b3aa-4ce8-aa43-97b75d22017b service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:33.810971 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-fa5dfcc7-8117-4c88-bdc1-8491f0069d0d req-b1fb8d13-b3aa-4ce8-aa43-97b75d22017b service nova] Creating event network-vif-plugged:a93886de-f812-40e6-81ba-b35e06454a66 for instance 6517823d-711a-4e24-9cdf-27812d522a46 on hv-cinder-84456 Jun 03 10:01:33.815887 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-fa5dfcc7-8117-4c88-bdc1-8491f0069d0d req-b1fb8d13-b3aa-4ce8-aa43-97b75d22017b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032197 Jun 03 10:01:33.816585 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 231/455] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:01:34.344881 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-e566543a-57c4-480d-94f8-4a83e52506b6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:34.345661 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-e566543a-57c4-480d-94f8-4a83e52506b6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:34.352168 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e566543a-57c4-480d-94f8-4a83e52506b6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:34.352465 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e566543a-57c4-480d-94f8-4a83e52506b6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:34.353390 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e566543a-57c4-480d-94f8-4a83e52506b6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:34.353824 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e566543a-57c4-480d-94f8-4a83e52506b6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:34.497438 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-e566543a-57c4-480d-94f8-4a83e52506b6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:34.507812 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-e566543a-57c4-480d-94f8-4a83e52506b6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1680 microversion: 2.1 time: 0.167140 Jun 03 10:01:34.508409 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 232/456] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:34 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:34.639469 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-ce53e44a-1b25-4766-93da-d3ceb9493177 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:34.640134 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-ce53e44a-1b25-4766-93da-d3ceb9493177 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:34.646423 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ce53e44a-1b25-4766-93da-d3ceb9493177 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:34.646875 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ce53e44a-1b25-4766-93da-d3ceb9493177 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:34.647675 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ce53e44a-1b25-4766-93da-d3ceb9493177 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:34.648111 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ce53e44a-1b25-4766-93da-d3ceb9493177 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:34.776198 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-ce53e44a-1b25-4766-93da-d3ceb9493177 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:34.784608 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-ce53e44a-1b25-4766-93da-d3ceb9493177 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:34.786147 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-ce53e44a-1b25-4766-93da-d3ceb9493177 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:34.787306 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-ce53e44a-1b25-4766-93da-d3ceb9493177 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1809 microversion: 2.20 time: 0.152077 Jun 03 10:01:34.787868 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 233/457] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:34 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:01:35.028134 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-ce30e207-620e-4dcc-9c05-96af9571a7be tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "POST /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.302114 Jun 03 10:01:35.031586 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 225/458] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jun 3 10:01:33 2022] POST /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846/os-volume_attachments => generated 194 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:01:35.526216 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-22c2affc-def8-4d8a-aa01-1a3d44a22534 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:35.538559 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-22c2affc-def8-4d8a-aa01-1a3d44a22534 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:35.538559 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-22c2affc-def8-4d8a-aa01-1a3d44a22534 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:35.538559 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-22c2affc-def8-4d8a-aa01-1a3d44a22534 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:35.538559 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-22c2affc-def8-4d8a-aa01-1a3d44a22534 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:35.539463 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-22c2affc-def8-4d8a-aa01-1a3d44a22534 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:35.669813 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-22c2affc-def8-4d8a-aa01-1a3d44a22534 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:35.677365 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-22c2affc-def8-4d8a-aa01-1a3d44a22534 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1680 microversion: 2.1 time: 0.155833 Jun 03 10:01:35.678029 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 234/459] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:35 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:35.806806 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-aa82224f-d7fb-41d4-9ec7-bd7343545786 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:35.807502 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-aa82224f-d7fb-41d4-9ec7-bd7343545786 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:35.814520 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-aa82224f-d7fb-41d4-9ec7-bd7343545786 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:35.814976 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-aa82224f-d7fb-41d4-9ec7-bd7343545786 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:35.815869 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-aa82224f-d7fb-41d4-9ec7-bd7343545786 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:35.816430 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-aa82224f-d7fb-41d4-9ec7-bd7343545786 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:35.949621 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-aa82224f-d7fb-41d4-9ec7-bd7343545786 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:35.960648 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-aa82224f-d7fb-41d4-9ec7-bd7343545786 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:35.962227 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-aa82224f-d7fb-41d4-9ec7-bd7343545786 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:35.963433 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-aa82224f-d7fb-41d4-9ec7-bd7343545786 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1809 microversion: 2.20 time: 0.161507 Jun 03 10:01:35.963982 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 226/460] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:35 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:36.106534 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-0903b8eb-74f2-45f8-93c5-7089a22c5534 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4957a648-29a9-48d1-a0d4-678b5866f51e", "device": "/dev/sdb"}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:01:36.109777 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-0903b8eb-74f2-45f8-93c5-7089a22c5534 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: dce70d56-25df-45f6-b6cc-6c97ca1ae107] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:36.116548 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0903b8eb-74f2-45f8-93c5-7089a22c5534 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:36.117330 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0903b8eb-74f2-45f8-93c5-7089a22c5534 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:36.118757 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0903b8eb-74f2-45f8-93c5-7089a22c5534 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:36.119911 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0903b8eb-74f2-45f8-93c5-7089a22c5534 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:36.272587 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:36.694798 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-251c837f-0f71-473b-b101-b0c809fad200 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:36.695408 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-251c837f-0f71-473b-b101-b0c809fad200 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:36.701505 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-251c837f-0f71-473b-b101-b0c809fad200 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:36.701981 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-251c837f-0f71-473b-b101-b0c809fad200 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:36.702744 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-251c837f-0f71-473b-b101-b0c809fad200 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:36.705756 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-251c837f-0f71-473b-b101-b0c809fad200 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:36.843625 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-251c837f-0f71-473b-b101-b0c809fad200 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:36.851212 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-251c837f-0f71-473b-b101-b0c809fad200 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1680 microversion: 2.1 time: 0.160408 Jun 03 10:01:36.851783 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 227/461] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:36 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:36.981322 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-44ae0b15-dc78-4a66-8a22-697d00db0db2 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:36.982626 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-44ae0b15-dc78-4a66-8a22-697d00db0db2 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:36.989043 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-44ae0b15-dc78-4a66-8a22-697d00db0db2 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:36.989686 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-44ae0b15-dc78-4a66-8a22-697d00db0db2 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:36.990553 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-44ae0b15-dc78-4a66-8a22-697d00db0db2 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:36.991098 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-44ae0b15-dc78-4a66-8a22-697d00db0db2 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:37.145994 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-44ae0b15-dc78-4a66-8a22-697d00db0db2 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:37.155209 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-44ae0b15-dc78-4a66-8a22-697d00db0db2 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:37.156749 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-44ae0b15-dc78-4a66-8a22-697d00db0db2 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:37.157940 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-44ae0b15-dc78-4a66-8a22-697d00db0db2 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1809 microversion: 2.20 time: 0.181374 Jun 03 10:01:37.158497 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 228/462] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:36 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:01:37.654906 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-0903b8eb-74f2-45f8-93c5-7089a22c5534 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "POST /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.553118 Jun 03 10:01:37.657944 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 235/463] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jun 3 10:01:36 2022] POST /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107/os-volume_attachments => generated 194 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:01:37.868759 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-c045414b-e0e3-472a-af6d-a8421899411f tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:37.872381 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-c045414b-e0e3-472a-af6d-a8421899411f tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:37.876597 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c045414b-e0e3-472a-af6d-a8421899411f tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:37.877036 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c045414b-e0e3-472a-af6d-a8421899411f tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:37.877826 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c045414b-e0e3-472a-af6d-a8421899411f tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:37.878309 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c045414b-e0e3-472a-af6d-a8421899411f tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:38.016308 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-c045414b-e0e3-472a-af6d-a8421899411f tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:38.023980 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-c045414b-e0e3-472a-af6d-a8421899411f tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1680 microversion: 2.1 time: 0.159258 Jun 03 10:01:38.024560 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 229/464] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:37 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:38.177606 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-a3057ce2-a7ab-458e-ba09-6c0232683ed8 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:38.178329 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-a3057ce2-a7ab-458e-ba09-6c0232683ed8 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:38.185414 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a3057ce2-a7ab-458e-ba09-6c0232683ed8 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:38.185902 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a3057ce2-a7ab-458e-ba09-6c0232683ed8 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:38.186661 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a3057ce2-a7ab-458e-ba09-6c0232683ed8 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:38.187096 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a3057ce2-a7ab-458e-ba09-6c0232683ed8 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:38.350340 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-a3057ce2-a7ab-458e-ba09-6c0232683ed8 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:38.360118 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-a3057ce2-a7ab-458e-ba09-6c0232683ed8 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:38.361602 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-a3057ce2-a7ab-458e-ba09-6c0232683ed8 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:38.362943 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-a3057ce2-a7ab-458e-ba09-6c0232683ed8 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1809 microversion: 2.20 time: 0.189901 Jun 03 10:01:38.363498 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 236/465] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:38 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:39.040769 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-043e8cc9-f451-4aa6-8ed4-b8982ec93b4f tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:39.041380 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-043e8cc9-f451-4aa6-8ed4-b8982ec93b4f tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:39.047952 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-043e8cc9-f451-4aa6-8ed4-b8982ec93b4f tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:39.048404 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-043e8cc9-f451-4aa6-8ed4-b8982ec93b4f tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:39.049170 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-043e8cc9-f451-4aa6-8ed4-b8982ec93b4f tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:39.049607 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-043e8cc9-f451-4aa6-8ed4-b8982ec93b4f tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:39.182809 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-043e8cc9-f451-4aa6-8ed4-b8982ec93b4f tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:39.190708 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-043e8cc9-f451-4aa6-8ed4-b8982ec93b4f tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1680 microversion: 2.1 time: 0.154002 Jun 03 10:01:39.191273 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 230/466] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:39 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:39.380593 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-eb1d7cea-2be5-46b7-90af-7a90246cd37d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:39.381195 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-eb1d7cea-2be5-46b7-90af-7a90246cd37d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:39.388554 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-eb1d7cea-2be5-46b7-90af-7a90246cd37d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:39.388997 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-eb1d7cea-2be5-46b7-90af-7a90246cd37d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:39.389751 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-eb1d7cea-2be5-46b7-90af-7a90246cd37d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:39.390210 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-eb1d7cea-2be5-46b7-90af-7a90246cd37d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:39.531836 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-eb1d7cea-2be5-46b7-90af-7a90246cd37d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:39.541716 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-eb1d7cea-2be5-46b7-90af-7a90246cd37d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:39.543454 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-eb1d7cea-2be5-46b7-90af-7a90246cd37d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:39.544751 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-eb1d7cea-2be5-46b7-90af-7a90246cd37d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1796 microversion: 2.20 time: 0.168004 Jun 03 10:01:39.545355 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 237/467] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:39 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1796 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:40.210848 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-158689e1-5a8a-4d56-adeb-3b1d0784a16f tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:40.211460 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-158689e1-5a8a-4d56-adeb-3b1d0784a16f tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:40.223428 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-158689e1-5a8a-4d56-adeb-3b1d0784a16f tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:40.224339 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-158689e1-5a8a-4d56-adeb-3b1d0784a16f tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:40.225277 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-158689e1-5a8a-4d56-adeb-3b1d0784a16f tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:40.225865 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-158689e1-5a8a-4d56-adeb-3b1d0784a16f tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:40.399617 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-158689e1-5a8a-4d56-adeb-3b1d0784a16f tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:40.410875 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-158689e1-5a8a-4d56-adeb-3b1d0784a16f tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1680 microversion: 2.1 time: 0.202903 Jun 03 10:01:40.410875 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 231/468] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:40 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1680 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:41.434345 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-1158a1ba-0ade-49d2-a778-20058ed8ad82 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:41.435738 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-1158a1ba-0ade-49d2-a778-20058ed8ad82 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:41.444116 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1158a1ba-0ade-49d2-a778-20058ed8ad82 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:41.444798 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1158a1ba-0ade-49d2-a778-20058ed8ad82 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:41.445752 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1158a1ba-0ade-49d2-a778-20058ed8ad82 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:41.446918 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1158a1ba-0ade-49d2-a778-20058ed8ad82 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:41.600492 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-1158a1ba-0ade-49d2-a778-20058ed8ad82 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:41.611040 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-1158a1ba-0ade-49d2-a778-20058ed8ad82 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1680 microversion: 2.1 time: 0.180972 Jun 03 10:01:41.621361 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 238/469] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:41 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:42.629042 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-d7f27ffb-4d6a-4bc1-b14f-d5bb8ca67ec6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:42.629656 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-d7f27ffb-4d6a-4bc1-b14f-d5bb8ca67ec6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:42.636948 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d7f27ffb-4d6a-4bc1-b14f-d5bb8ca67ec6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:42.637404 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d7f27ffb-4d6a-4bc1-b14f-d5bb8ca67ec6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:42.638205 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d7f27ffb-4d6a-4bc1-b14f-d5bb8ca67ec6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:42.638643 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d7f27ffb-4d6a-4bc1-b14f-d5bb8ca67ec6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:42.874360 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-d7f27ffb-4d6a-4bc1-b14f-d5bb8ca67ec6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:42.885873 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-d7f27ffb-4d6a-4bc1-b14f-d5bb8ca67ec6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1680 microversion: 2.1 time: 0.260637 Jun 03 10:01:42.887268 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 232/470] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:42 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1680 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:43.738292 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-480d6a87-7ef4-493b-af58-4174ff0565a3 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:01:43.738292 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-480d6a87-7ef4-493b-af58-4174ff0565a3 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:43.744968 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-480d6a87-7ef4-493b-af58-4174ff0565a3 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:43.745840 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-480d6a87-7ef4-493b-af58-4174ff0565a3 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:43.746901 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-480d6a87-7ef4-493b-af58-4174ff0565a3 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:43.747525 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-480d6a87-7ef4-493b-af58-4174ff0565a3 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:43.785574 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.objects.instance [None req-480d6a87-7ef4-493b-af58-4174ff0565a3 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lazy-loading 'flavor' on Instance uuid 5809214c-e01c-4ff2-adbf-097cf27a9846 {{(pid=125066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:01:43.906522 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-20bee104-4d9f-4bfd-a9dd-973bc211d775 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:43.907235 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-20bee104-4d9f-4bfd-a9dd-973bc211d775 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:43.920143 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-20bee104-4d9f-4bfd-a9dd-973bc211d775 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:43.920665 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-20bee104-4d9f-4bfd-a9dd-973bc211d775 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:43.921679 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-20bee104-4d9f-4bfd-a9dd-973bc211d775 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:43.922215 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-20bee104-4d9f-4bfd-a9dd-973bc211d775 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:43.948719 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:44.154384 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-20bee104-4d9f-4bfd-a9dd-973bc211d775 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:44.162289 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-20bee104-4d9f-4bfd-a9dd-973bc211d775 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1657 microversion: 2.1 time: 0.261542 Jun 03 10:01:44.162868 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 233/471] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:43 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1657 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:44.178585 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-3f45e035-2c7d-4d22-b0d7-e9ae63ccd5ba tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:01:44.185271 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3f45e035-2c7d-4d22-b0d7-e9ae63ccd5ba tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:44.185725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3f45e035-2c7d-4d22-b0d7-e9ae63ccd5ba tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:44.208900 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-3f45e035-2c7d-4d22-b0d7-e9ae63ccd5ba tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Going to try to start instance {{(pid=125065) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 03 10:01:44.348880 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-480d6a87-7ef4-493b-af58-4174ff0565a3 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "POST /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846/action" status: 200 len: 32 microversion: 2.1 time: 0.617958 Jun 03 10:01:44.349496 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 239/472] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jun 3 10:01:43 2022] POST /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846/action => generated 32 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 10:01:44.358706 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-b36e9acd-44b9-46ab-b47f-3f7739fadb76 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:44.360167 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-b36e9acd-44b9-46ab-b47f-3f7739fadb76 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:44.367074 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b36e9acd-44b9-46ab-b47f-3f7739fadb76 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:44.367516 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b36e9acd-44b9-46ab-b47f-3f7739fadb76 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:44.368969 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b36e9acd-44b9-46ab-b47f-3f7739fadb76 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:44.369579 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b36e9acd-44b9-46ab-b47f-3f7739fadb76 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:44.473457 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-3f45e035-2c7d-4d22-b0d7-e9ae63ccd5ba tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "POST /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3/action" status: 202 len: 0 microversion: 2.1 time: 0.298416 Jun 03 10:01:44.474440 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 234/473] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jun 3 10:01:44 2022] POST /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 03 10:01:44.489377 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-3412d0d1-7a6b-4fca-8970-f7ba3a247d1a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:44.490670 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-3412d0d1-7a6b-4fca-8970-f7ba3a247d1a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:44.498665 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3412d0d1-7a6b-4fca-8970-f7ba3a247d1a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:44.499335 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3412d0d1-7a6b-4fca-8970-f7ba3a247d1a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:44.503730 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3412d0d1-7a6b-4fca-8970-f7ba3a247d1a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:44.503730 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3412d0d1-7a6b-4fca-8970-f7ba3a247d1a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:44.520887 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-b36e9acd-44b9-46ab-b47f-3f7739fadb76 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:44.532879 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-b36e9acd-44b9-46ab-b47f-3f7739fadb76 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1735 microversion: 2.1 time: 0.178024 Jun 03 10:01:44.533715 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 240/474] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:44 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:44.746249 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-3412d0d1-7a6b-4fca-8970-f7ba3a247d1a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:44.755461 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-3412d0d1-7a6b-4fca-8970-f7ba3a247d1a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1666 microversion: 2.1 time: 0.276313 Jun 03 10:01:44.756314 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 235/475] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:44 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1666 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:45.551356 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-52bf268a-89fe-4a60-869a-b31c9afa24ba tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:45.551973 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-52bf268a-89fe-4a60-869a-b31c9afa24ba tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:45.560605 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-52bf268a-89fe-4a60-869a-b31c9afa24ba tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:45.561425 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-52bf268a-89fe-4a60-869a-b31c9afa24ba tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:45.562477 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-52bf268a-89fe-4a60-869a-b31c9afa24ba tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:45.563131 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-52bf268a-89fe-4a60-869a-b31c9afa24ba tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:45.755458 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-52bf268a-89fe-4a60-869a-b31c9afa24ba tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:45.765244 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-52bf268a-89fe-4a60-869a-b31c9afa24ba tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1735 microversion: 2.1 time: 0.217752 Jun 03 10:01:45.776882 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 241/476] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:45 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1735 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:45.782925 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-2063d06e-3910-4366-aba5-304462ad9ab1 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:45.783590 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-2063d06e-3910-4366-aba5-304462ad9ab1 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:45.803100 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2063d06e-3910-4366-aba5-304462ad9ab1 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:45.803100 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2063d06e-3910-4366-aba5-304462ad9ab1 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:45.803100 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2063d06e-3910-4366-aba5-304462ad9ab1 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:45.803100 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2063d06e-3910-4366-aba5-304462ad9ab1 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:46.061066 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-e8bc5135-e694-40da-9b45-375384d2ddde tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1623088295", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1365846056", "security_groups": [{"name": "tempest-secgroup-smoke-921144121"}], "block_device_mapping_v2": [{"uuid": "b39a96c2-5db4-4e79-83a3-9de06e8fdc21", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cdd39ad8-1097-4745-8715-b421d9c9917f"}]}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:01:46.063717 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-2063d06e-3910-4366-aba5-304462ad9ab1 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:46.075297 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-2063d06e-3910-4366-aba5-304462ad9ab1 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1666 microversion: 2.1 time: 0.297853 Jun 03 10:01:46.078609 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 236/477] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:45 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1666 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:46.193743 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.network.neutron [None req-e8bc5135-e694-40da-9b45-375384d2ddde tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] validate_networks() for [('cdd39ad8-1097-4745-8715-b421d9c9917f', None, None, None, None, None)] {{(pid=125066) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 10:01:46.620530 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-e8bc5135-e694-40da-9b45-375384d2ddde tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Flavor limits 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 10:01:46.621077 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-e8bc5135-e694-40da-9b45-375384d2ddde tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Image limits 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 10:01:46.621405 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-e8bc5135-e694-40da-9b45-375384d2ddde tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Flavor pref 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 10:01:46.621802 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-e8bc5135-e694-40da-9b45-375384d2ddde tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Image pref 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 10:01:46.622242 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-e8bc5135-e694-40da-9b45-375384d2ddde tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 10:01:46.632748 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e8bc5135-e694-40da-9b45-375384d2ddde tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:46.633261 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e8bc5135-e694-40da-9b45-375384d2ddde tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:46.634212 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e8bc5135-e694-40da-9b45-375384d2ddde tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:46.634713 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e8bc5135-e694-40da-9b45-375384d2ddde tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:46.653202 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-e8bc5135-e694-40da-9b45-375384d2ddde tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Getting quotas for project 5476f21b29944eb69e32a2d97b328aed. Resources: {'ram', 'instances', 'cores'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:01:46.657641 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-e8bc5135-e694-40da-9b45-375384d2ddde tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Getting quotas for user 646fecf4405c41a0bc062c6b54fd311c and project 5476f21b29944eb69e32a2d97b328aed. Resources: {'ram', 'instances', 'cores'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:01:46.718993 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-e8bc5135-e694-40da-9b45-375384d2ddde tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Going to run 1 instances... {{(pid=125066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 10:01:46.722703 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-e8bc5135-e694-40da-9b45-375384d2ddde tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b39a96c2-5db4-4e79-83a3-9de06e8fdc21',volume_size=None,volume_type=None)] {{(pid=125066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 10:01:46.783042 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-0d27d786-5ba1-4597-bc6b-1e6f2ead4495 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:46.783646 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-0d27d786-5ba1-4597-bc6b-1e6f2ead4495 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:46.791060 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0d27d786-5ba1-4597-bc6b-1e6f2ead4495 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:46.791539 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0d27d786-5ba1-4597-bc6b-1e6f2ead4495 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:46.792302 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0d27d786-5ba1-4597-bc6b-1e6f2ead4495 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:46.792812 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0d27d786-5ba1-4597-bc6b-1e6f2ead4495 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:46.998710 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-0d27d786-5ba1-4597-bc6b-1e6f2ead4495 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:47.006749 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-0d27d786-5ba1-4597-bc6b-1e6f2ead4495 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1735 microversion: 2.1 time: 0.227706 Jun 03 10:01:47.007355 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 237/478] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:46 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1735 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:47.098353 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-7b2197cd-7207-4a2e-9cf8-0ee257f98a98 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:47.099258 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-7b2197cd-7207-4a2e-9cf8-0ee257f98a98 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:47.105642 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7b2197cd-7207-4a2e-9cf8-0ee257f98a98 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:47.106285 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7b2197cd-7207-4a2e-9cf8-0ee257f98a98 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:47.110086 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7b2197cd-7207-4a2e-9cf8-0ee257f98a98 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:47.110873 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7b2197cd-7207-4a2e-9cf8-0ee257f98a98 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:47.252192 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 10:01:47.252378 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Fri Jun 3 10:01:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.42) !!! Jun 03 10:01:47.365231 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-e8bc5135-e694-40da-9b45-375384d2ddde tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.313208 Jun 03 10:01:47.366503 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 242/479] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 3 10:01:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 1315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 10:01:47.377557 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-1fe5dcd2-c19b-4cfd-8381-e02cf424ee3c tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:47.378531 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-1fe5dcd2-c19b-4cfd-8381-e02cf424ee3c tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:47.423350 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-7b2197cd-7207-4a2e-9cf8-0ee257f98a98 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:47.457474 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-7b2197cd-7207-4a2e-9cf8-0ee257f98a98 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1666 microversion: 2.1 time: 0.363686 Jun 03 10:01:47.459761 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 238/480] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:47 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1666 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:47.501820 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-1fe5dcd2-c19b-4cfd-8381-e02cf424ee3c tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:47.515090 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-1fe5dcd2-c19b-4cfd-8381-e02cf424ee3c tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1095 microversion: 2.1 time: 0.141816 Jun 03 10:01:47.516116 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 243/481] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:47 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1095 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:48.026331 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-4fd71c3a-052e-4d2c-bc74-771cea7e9671 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:48.028768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-4fd71c3a-052e-4d2c-bc74-771cea7e9671 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:48.036287 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4fd71c3a-052e-4d2c-bc74-771cea7e9671 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:48.037208 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4fd71c3a-052e-4d2c-bc74-771cea7e9671 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:48.038196 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4fd71c3a-052e-4d2c-bc74-771cea7e9671 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:48.039217 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4fd71c3a-052e-4d2c-bc74-771cea7e9671 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:48.269755 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-4fd71c3a-052e-4d2c-bc74-771cea7e9671 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:48.279134 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-4fd71c3a-052e-4d2c-bc74-771cea7e9671 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1735 microversion: 2.1 time: 0.257282 Jun 03 10:01:48.279817 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 239/482] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:48 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1735 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:48.476963 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-30b1ba53-c852-4182-97c8-f33d995282e8 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:48.477609 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-30b1ba53-c852-4182-97c8-f33d995282e8 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:48.486548 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-30b1ba53-c852-4182-97c8-f33d995282e8 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:48.487363 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-30b1ba53-c852-4182-97c8-f33d995282e8 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:48.488412 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-30b1ba53-c852-4182-97c8-f33d995282e8 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:48.489130 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-30b1ba53-c852-4182-97c8-f33d995282e8 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:48.532669 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-d09365ea-281b-4d1b-be64-94a88fbf1e85 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:48.533648 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-d09365ea-281b-4d1b-be64-94a88fbf1e85 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:48.650220 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-d09365ea-281b-4d1b-be64-94a88fbf1e85 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:48.657794 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-d09365ea-281b-4d1b-be64-94a88fbf1e85 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1095 microversion: 2.1 time: 0.129082 Jun 03 10:01:48.658705 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 240/483] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:48 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1095 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:48.769958 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-30b1ba53-c852-4182-97c8-f33d995282e8 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:48.779191 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-30b1ba53-c852-4182-97c8-f33d995282e8 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1670 microversion: 2.1 time: 0.306386 Jun 03 10:01:48.780045 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 244/484] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:48 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1670 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:49.296064 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-0e1f1b75-9237-4caa-928e-06836d63774d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:49.297273 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-0e1f1b75-9237-4caa-928e-06836d63774d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:49.310934 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0e1f1b75-9237-4caa-928e-06836d63774d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:49.311576 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0e1f1b75-9237-4caa-928e-06836d63774d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:49.312344 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0e1f1b75-9237-4caa-928e-06836d63774d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:49.312807 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0e1f1b75-9237-4caa-928e-06836d63774d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:49.507538 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-0e1f1b75-9237-4caa-928e-06836d63774d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:49.520370 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-0e1f1b75-9237-4caa-928e-06836d63774d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1735 microversion: 2.1 time: 0.228080 Jun 03 10:01:49.534545 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 241/485] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:49 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1735 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:49.676235 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-dc346abd-f3db-4771-92bc-e651ace182ef tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:49.676867 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-dc346abd-f3db-4771-92bc-e651ace182ef tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:49.681762 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:49.702088 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-dc346abd-f3db-4771-92bc-e651ace182ef tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:49.702864 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-dc346abd-f3db-4771-92bc-e651ace182ef tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:49.704209 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-dc346abd-f3db-4771-92bc-e651ace182ef tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:49.704874 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-dc346abd-f3db-4771-92bc-e651ace182ef tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:49.815134 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-dc346abd-f3db-4771-92bc-e651ace182ef tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:49.824482 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-dc346abd-f3db-4771-92bc-e651ace182ef tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1137 microversion: 2.1 time: 0.152635 Jun 03 10:01:49.829961 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 245/486] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:49 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1137 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:50.542694 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-c3c7d5aa-67b3-4d16-8381-ebc7691bc61e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:50.544194 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-c3c7d5aa-67b3-4d16-8381-ebc7691bc61e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:50.551926 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c3c7d5aa-67b3-4d16-8381-ebc7691bc61e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:50.552667 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c3c7d5aa-67b3-4d16-8381-ebc7691bc61e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:50.553656 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c3c7d5aa-67b3-4d16-8381-ebc7691bc61e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:50.554297 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c3c7d5aa-67b3-4d16-8381-ebc7691bc61e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:50.737964 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-c3c7d5aa-67b3-4d16-8381-ebc7691bc61e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:50.747096 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-c3c7d5aa-67b3-4d16-8381-ebc7691bc61e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1735 microversion: 2.1 time: 0.208823 Jun 03 10:01:50.747678 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 242/487] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:50 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1735 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:50.841479 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-d370ce89-0d2f-4e71-8d60-464b85cbb33a tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:50.842131 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-d370ce89-0d2f-4e71-8d60-464b85cbb33a tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:50.850295 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d370ce89-0d2f-4e71-8d60-464b85cbb33a tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:50.850744 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d370ce89-0d2f-4e71-8d60-464b85cbb33a tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:50.851507 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d370ce89-0d2f-4e71-8d60-464b85cbb33a tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:50.851967 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d370ce89-0d2f-4e71-8d60-464b85cbb33a tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:50.916394 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-d370ce89-0d2f-4e71-8d60-464b85cbb33a tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:50.929620 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-d370ce89-0d2f-4e71-8d60-464b85cbb33a tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1193 microversion: 2.1 time: 0.091765 Jun 03 10:01:50.930907 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 246/488] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:50 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1193 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:51.766175 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-13bbde24-1504-4e6d-8687-51f2dd4d477f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:51.767173 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-13bbde24-1504-4e6d-8687-51f2dd4d477f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:51.789138 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-13bbde24-1504-4e6d-8687-51f2dd4d477f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:51.790603 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-13bbde24-1504-4e6d-8687-51f2dd4d477f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:51.791947 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-13bbde24-1504-4e6d-8687-51f2dd4d477f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:51.793730 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-13bbde24-1504-4e6d-8687-51f2dd4d477f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:51.948297 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-efe98e54-4aa1-4d54-b4d7-7e8a5ba2ebc5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:51.949649 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-efe98e54-4aa1-4d54-b4d7-7e8a5ba2ebc5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:51.962620 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-efe98e54-4aa1-4d54-b4d7-7e8a5ba2ebc5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:51.968606 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-efe98e54-4aa1-4d54-b4d7-7e8a5ba2ebc5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:51.971383 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-efe98e54-4aa1-4d54-b4d7-7e8a5ba2ebc5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:51.975506 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-efe98e54-4aa1-4d54-b4d7-7e8a5ba2ebc5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:52.107738 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-efe98e54-4aa1-4d54-b4d7-7e8a5ba2ebc5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:52.110470 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-13bbde24-1504-4e6d-8687-51f2dd4d477f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:52.122577 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-13bbde24-1504-4e6d-8687-51f2dd4d477f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1735 microversion: 2.1 time: 0.357933 Jun 03 10:01:52.123540 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-efe98e54-4aa1-4d54-b4d7-7e8a5ba2ebc5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1211 microversion: 2.1 time: 0.180297 Jun 03 10:01:52.123764 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 243/489] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:51 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1735 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:52.126085 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 247/490] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:51 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1211 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:52.336793 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-06542043-243a-4e01-8104-e825f88ba98d tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Action: 'create', calling method: .version_select at 0x7f8d2375ad30>, body: {"keypair": {"name": "tempest-TestShelveInstance-2115358546", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBK+jWZYAOA0v6Ijttd3r4TvVQ3i49+pQGr5VF/HMFn7EKvSvJTPjSk3dJEWa2Gq3GvZtyiU5I0OXp72cIRDA5T/UOsiaaAHLq0Hx8uovZsCVYeiMYGBhy07cZZdeemcsA=="}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:01:52.359446 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.quota [None req-06542043-243a-4e01-8104-e825f88ba98d tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Getting quotas for project 3c44b2575d1945e0a100fe081e5af582. Resources: {'key_pairs'} {{(pid=125065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:01:52.371415 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.quota [None req-06542043-243a-4e01-8104-e825f88ba98d tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Getting quotas for user 5d332241d6f84959880bfa99a24805dc and project 3c44b2575d1945e0a100fe081e5af582. Resources: {'key_pairs'} {{(pid=125065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:01:52.470038 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-06542043-243a-4e01-8104-e825f88ba98d tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.302870 Jun 03 10:01:52.470038 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 244/491] 10.222.0.42 () {60 vars in 1158 bytes} [Fri Jun 3 10:01:52 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:01:53.141119 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-ccf54245-ebb8-4f3b-bb85-fcb0fdc6e525 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:53.142328 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-ccf54245-ebb8-4f3b-bb85-fcb0fdc6e525 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:53.143248 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-3a396812-96f1-48c3-a9df-74ee69e24349 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:53.143857 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-3a396812-96f1-48c3-a9df-74ee69e24349 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:53.150872 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ccf54245-ebb8-4f3b-bb85-fcb0fdc6e525 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:53.151322 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ccf54245-ebb8-4f3b-bb85-fcb0fdc6e525 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:53.152294 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ccf54245-ebb8-4f3b-bb85-fcb0fdc6e525 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:53.152932 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ccf54245-ebb8-4f3b-bb85-fcb0fdc6e525 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:53.158526 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3a396812-96f1-48c3-a9df-74ee69e24349 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:53.159203 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3a396812-96f1-48c3-a9df-74ee69e24349 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:53.160252 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3a396812-96f1-48c3-a9df-74ee69e24349 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:53.160923 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3a396812-96f1-48c3-a9df-74ee69e24349 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:53.473267 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-3a396812-96f1-48c3-a9df-74ee69e24349 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:53.476806 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-ccf54245-ebb8-4f3b-bb85-fcb0fdc6e525 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:53.483986 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-3a396812-96f1-48c3-a9df-74ee69e24349 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1266 microversion: 2.1 time: 0.345194 Jun 03 10:01:53.484838 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 245/492] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:53 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1266 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:53.486479 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-ccf54245-ebb8-4f3b-bb85-fcb0fdc6e525 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1735 microversion: 2.1 time: 0.349380 Jun 03 10:01:53.487129 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 248/493] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:53 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1735 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:53.645206 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-b2f8983a-5c50-4196-841a-8d1497e11cb3 req-ee1cc032-c1a7-4eef-85fa-9c8be9d6c56f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b4620df-63bb-4550-b854-4c81bb1219e0", "tag": "9c77efae-7eef-404e-beac-b5252e585eb9"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:01:53.655129 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-b2f8983a-5c50-4196-841a-8d1497e11cb3 req-ee1cc032-c1a7-4eef-85fa-9c8be9d6c56f service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:53.655941 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-b2f8983a-5c50-4196-841a-8d1497e11cb3 req-ee1cc032-c1a7-4eef-85fa-9c8be9d6c56f service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:53.668918 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-b2f8983a-5c50-4196-841a-8d1497e11cb3 req-ee1cc032-c1a7-4eef-85fa-9c8be9d6c56f service nova] Creating event network-changed:9c77efae-7eef-404e-beac-b5252e585eb9 for instance 7b4620df-63bb-4550-b854-4c81bb1219e0 on hv-cinder-84456 Jun 03 10:01:53.674467 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-b2f8983a-5c50-4196-841a-8d1497e11cb3 req-ee1cc032-c1a7-4eef-85fa-9c8be9d6c56f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033193 Jun 03 10:01:53.675278 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 246/494] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:01:54.502300 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-3313a030-2761-4fca-a898-a681e8fc4cda tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:54.503025 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-3313a030-2761-4fca-a898-a681e8fc4cda tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:54.505356 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-fa4fbdf8-1385-47df-b70f-791202e92348 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:54.512237 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-fa4fbdf8-1385-47df-b70f-791202e92348 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:54.512582 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3313a030-2761-4fca-a898-a681e8fc4cda tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:54.512582 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3313a030-2761-4fca-a898-a681e8fc4cda tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:54.512582 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3313a030-2761-4fca-a898-a681e8fc4cda tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:54.512582 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3313a030-2761-4fca-a898-a681e8fc4cda tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:54.514237 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-fa4fbdf8-1385-47df-b70f-791202e92348 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:54.514768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-fa4fbdf8-1385-47df-b70f-791202e92348 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:54.515660 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-fa4fbdf8-1385-47df-b70f-791202e92348 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:54.516086 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-fa4fbdf8-1385-47df-b70f-791202e92348 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:54.746781 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-3313a030-2761-4fca-a898-a681e8fc4cda tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:54.751050 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-fa4fbdf8-1385-47df-b70f-791202e92348 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:54.758273 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-3313a030-2761-4fca-a898-a681e8fc4cda tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1266 microversion: 2.1 time: 0.260991 Jun 03 10:01:54.764075 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-fa4fbdf8-1385-47df-b70f-791202e92348 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1735 microversion: 2.1 time: 0.264395 Jun 03 10:01:54.765381 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 247/495] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:54 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1735 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:54.773512 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 249/496] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:54 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1266 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:55.778162 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-5ebebbfa-05d4-4e8a-9af4-da5eb3524c1b tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:55.782375 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-5ebebbfa-05d4-4e8a-9af4-da5eb3524c1b tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:55.782492 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-eea2d5c4-c7e6-48e3-9027-9a549fc1867f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:55.782492 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-eea2d5c4-c7e6-48e3-9027-9a549fc1867f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:55.786342 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5ebebbfa-05d4-4e8a-9af4-da5eb3524c1b tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:55.786797 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5ebebbfa-05d4-4e8a-9af4-da5eb3524c1b tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:55.787659 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5ebebbfa-05d4-4e8a-9af4-da5eb3524c1b tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:55.788091 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5ebebbfa-05d4-4e8a-9af4-da5eb3524c1b tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:55.789977 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-eea2d5c4-c7e6-48e3-9027-9a549fc1867f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:55.790446 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-eea2d5c4-c7e6-48e3-9027-9a549fc1867f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:55.791240 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-eea2d5c4-c7e6-48e3-9027-9a549fc1867f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:55.791654 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-eea2d5c4-c7e6-48e3-9027-9a549fc1867f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:56.074024 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-eea2d5c4-c7e6-48e3-9027-9a549fc1867f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:56.077572 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-5ebebbfa-05d4-4e8a-9af4-da5eb3524c1b tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:56.079876 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:56.086089 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-5ebebbfa-05d4-4e8a-9af4-da5eb3524c1b tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1266 microversion: 2.1 time: 0.312654 Jun 03 10:01:56.086692 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 250/497] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:55 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1266 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:56.102482 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-eea2d5c4-c7e6-48e3-9027-9a549fc1867f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1735 microversion: 2.1 time: 0.324407 Jun 03 10:01:56.103066 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 248/498] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:55 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1735 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:57.103240 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-9e449635-32af-4d6e-8507-22260276df87 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:57.103760 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-9e449635-32af-4d6e-8507-22260276df87 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:57.106002 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell0:SELECT=2 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:57.111695 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9e449635-32af-4d6e-8507-22260276df87 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:57.112145 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9e449635-32af-4d6e-8507-22260276df87 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:57.112917 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9e449635-32af-4d6e-8507-22260276df87 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:57.113355 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9e449635-32af-4d6e-8507-22260276df87 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:57.119326 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-c72a45dc-44d5-4bf1-8dbc-397aa55f4eec tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:57.119961 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-c72a45dc-44d5-4bf1-8dbc-397aa55f4eec tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:57.122412 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:57.127185 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c72a45dc-44d5-4bf1-8dbc-397aa55f4eec tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:57.127632 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c72a45dc-44d5-4bf1-8dbc-397aa55f4eec tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:57.128394 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c72a45dc-44d5-4bf1-8dbc-397aa55f4eec tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:57.128828 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c72a45dc-44d5-4bf1-8dbc-397aa55f4eec tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:57.325821 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-9e449635-32af-4d6e-8507-22260276df87 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:57.330974 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-c72a45dc-44d5-4bf1-8dbc-397aa55f4eec tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:57.334825 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-9e449635-32af-4d6e-8507-22260276df87 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1266 microversion: 2.1 time: 0.235499 Jun 03 10:01:57.335420 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 251/499] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:57 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:57.341157 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-c72a45dc-44d5-4bf1-8dbc-397aa55f4eec tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1735 microversion: 2.1 time: 0.226020 Jun 03 10:01:57.341873 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 249/500] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:57 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1735 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:58.352416 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-57781870-8956-4aa2-99d4-b12a0b63399d tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:58.353708 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-57781870-8956-4aa2-99d4-b12a0b63399d tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:58.355654 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell0:SELECT=8 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:58.358240 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-8509fdf4-a077-4727-befe-0529556bf664 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:58.359012 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-8509fdf4-a077-4727-befe-0529556bf664 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:58.361001 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-57781870-8956-4aa2-99d4-b12a0b63399d tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:58.361455 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-57781870-8956-4aa2-99d4-b12a0b63399d tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:58.362239 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-57781870-8956-4aa2-99d4-b12a0b63399d tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:58.362674 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-57781870-8956-4aa2-99d4-b12a0b63399d tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:58.365559 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8509fdf4-a077-4727-befe-0529556bf664 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:58.366080 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8509fdf4-a077-4727-befe-0529556bf664 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:58.379139 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8509fdf4-a077-4727-befe-0529556bf664 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:58.379139 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8509fdf4-a077-4727-befe-0529556bf664 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:58.565821 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-57781870-8956-4aa2-99d4-b12a0b63399d tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:58.572589 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-8509fdf4-a077-4727-befe-0529556bf664 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:58.574392 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-57781870-8956-4aa2-99d4-b12a0b63399d tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1266 microversion: 2.1 time: 0.226196 Jun 03 10:01:58.575042 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 252/501] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:58 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:58.580604 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-8509fdf4-a077-4727-befe-0529556bf664 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1735 microversion: 2.1 time: 0.226212 Jun 03 10:01:58.581161 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 250/502] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:58 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1735 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:59.591926 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-b98dec8c-65c6-4105-9a4b-ca82a77940ff tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:59.592556 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-b98dec8c-65c6-4105-9a4b-ca82a77940ff tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:59.597655 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-33922dcd-d1bf-4b1d-a0c6-dc1ff2d17983 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:59.598297 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-33922dcd-d1bf-4b1d-a0c6-dc1ff2d17983 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:59.599370 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b98dec8c-65c6-4105-9a4b-ca82a77940ff tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:59.599807 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b98dec8c-65c6-4105-9a4b-ca82a77940ff tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:59.600572 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b98dec8c-65c6-4105-9a4b-ca82a77940ff tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:59.601006 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b98dec8c-65c6-4105-9a4b-ca82a77940ff tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:59.604837 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-33922dcd-d1bf-4b1d-a0c6-dc1ff2d17983 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:59.605282 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-33922dcd-d1bf-4b1d-a0c6-dc1ff2d17983 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:59.606132 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-33922dcd-d1bf-4b1d-a0c6-dc1ff2d17983 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:59.606588 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-33922dcd-d1bf-4b1d-a0c6-dc1ff2d17983 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:59.808554 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-b98dec8c-65c6-4105-9a4b-ca82a77940ff tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:59.812604 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-33922dcd-d1bf-4b1d-a0c6-dc1ff2d17983 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:59.816170 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:59.816497 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-b98dec8c-65c6-4105-9a4b-ca82a77940ff tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1266 microversion: 2.1 time: 0.228942 Jun 03 10:01:59.817420 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 253/503] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:59 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:59.822636 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-33922dcd-d1bf-4b1d-a0c6-dc1ff2d17983 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1735 microversion: 2.1 time: 0.228008 Jun 03 10:01:59.823240 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 251/504] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:59 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1735 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:02:00.834861 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-ef40d872-bb25-4eb1-9305-619fc5365d97 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:00.835528 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-ef40d872-bb25-4eb1-9305-619fc5365d97 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:00.839904 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-341c6a53-976e-4e45-b30b-b14661202b2b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:00.840590 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-341c6a53-976e-4e45-b30b-b14661202b2b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:00.842551 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ef40d872-bb25-4eb1-9305-619fc5365d97 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:00.843050 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ef40d872-bb25-4eb1-9305-619fc5365d97 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:00.843826 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ef40d872-bb25-4eb1-9305-619fc5365d97 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:00.844265 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ef40d872-bb25-4eb1-9305-619fc5365d97 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:00.848122 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-341c6a53-976e-4e45-b30b-b14661202b2b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:00.848573 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-341c6a53-976e-4e45-b30b-b14661202b2b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:00.849348 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-341c6a53-976e-4e45-b30b-b14661202b2b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:00.850076 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-341c6a53-976e-4e45-b30b-b14661202b2b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:01.048162 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-ef40d872-bb25-4eb1-9305-619fc5365d97 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:01.055658 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-ef40d872-bb25-4eb1-9305-619fc5365d97 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1266 microversion: 2.1 time: 0.224828 Jun 03 10:02:01.056303 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 254/505] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:00 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:01.062770 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-341c6a53-976e-4e45-b30b-b14661202b2b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:01.071404 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-341c6a53-976e-4e45-b30b-b14661202b2b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1735 microversion: 2.1 time: 0.235886 Jun 03 10:02:01.075610 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 252/506] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:00 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1735 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:02:02.072624 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-9824d4f3-0a92-4067-ae16-6a60ec8806fd tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:02.073212 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-9824d4f3-0a92-4067-ae16-6a60ec8806fd tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:02.079651 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9824d4f3-0a92-4067-ae16-6a60ec8806fd tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:02.080092 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9824d4f3-0a92-4067-ae16-6a60ec8806fd tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:02.080838 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9824d4f3-0a92-4067-ae16-6a60ec8806fd tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:02.081265 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9824d4f3-0a92-4067-ae16-6a60ec8806fd tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:02.088628 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-a780b35d-a054-4ad7-8f43-50208156c639 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:02.089271 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-a780b35d-a054-4ad7-8f43-50208156c639 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:02.095813 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a780b35d-a054-4ad7-8f43-50208156c639 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:02.096264 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a780b35d-a054-4ad7-8f43-50208156c639 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:02.097032 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a780b35d-a054-4ad7-8f43-50208156c639 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:02.097467 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a780b35d-a054-4ad7-8f43-50208156c639 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:02.291786 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-9824d4f3-0a92-4067-ae16-6a60ec8806fd tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:02.291918 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-a780b35d-a054-4ad7-8f43-50208156c639 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:02.292016 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-9824d4f3-0a92-4067-ae16-6a60ec8806fd tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1266 microversion: 2.1 time: 0.220460 Jun 03 10:02:02.292016 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 255/507] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:02 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:02.297933 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-a780b35d-a054-4ad7-8f43-50208156c639 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1735 microversion: 2.1 time: 0.209531 Jun 03 10:02:02.297933 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 253/508] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:02 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1735 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:03.308020 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-7a41e501-0d90-4d7f-8a92-4d96fa1ed39c tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:03.308697 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-7a41e501-0d90-4d7f-8a92-4d96fa1ed39c tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:03.311496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-6d3c73f4-e482-4c6f-b4a1-087beffd74a7 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:03.312140 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-6d3c73f4-e482-4c6f-b4a1-087beffd74a7 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:03.314100 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell0:SELECT=6 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:03.316395 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7a41e501-0d90-4d7f-8a92-4d96fa1ed39c tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:03.316858 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7a41e501-0d90-4d7f-8a92-4d96fa1ed39c tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:03.317646 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7a41e501-0d90-4d7f-8a92-4d96fa1ed39c tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:03.318193 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7a41e501-0d90-4d7f-8a92-4d96fa1ed39c tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:03.319926 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6d3c73f4-e482-4c6f-b4a1-087beffd74a7 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:03.320323 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6d3c73f4-e482-4c6f-b4a1-087beffd74a7 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:03.321102 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6d3c73f4-e482-4c6f-b4a1-087beffd74a7 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:03.321540 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6d3c73f4-e482-4c6f-b4a1-087beffd74a7 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:03.515159 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-7a41e501-0d90-4d7f-8a92-4d96fa1ed39c tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:03.526492 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-7a41e501-0d90-4d7f-8a92-4d96fa1ed39c tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1266 microversion: 2.1 time: 0.222767 Jun 03 10:02:03.527079 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 256/509] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:03 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:03.533985 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-6d3c73f4-e482-4c6f-b4a1-087beffd74a7 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:03.537247 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-6d3c73f4-e482-4c6f-b4a1-087beffd74a7 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1735 microversion: 2.1 time: 0.229508 Jun 03 10:02:03.537804 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 254/510] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:03 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1735 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:02:04.543512 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-94c947f6-1b67-4558-97f5-f584d366346d tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:04.544130 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-94c947f6-1b67-4558-97f5-f584d366346d tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:04.550650 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-94c947f6-1b67-4558-97f5-f584d366346d tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:04.551105 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-94c947f6-1b67-4558-97f5-f584d366346d tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:04.551874 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-94c947f6-1b67-4558-97f5-f584d366346d tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:04.552317 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-94c947f6-1b67-4558-97f5-f584d366346d tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:04.555318 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-ea8e513e-1c9a-4d8b-b53a-4220b7a455dd tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:04.555921 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-ea8e513e-1c9a-4d8b-b53a-4220b7a455dd tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:04.563181 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ea8e513e-1c9a-4d8b-b53a-4220b7a455dd tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:04.563642 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ea8e513e-1c9a-4d8b-b53a-4220b7a455dd tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:04.564455 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ea8e513e-1c9a-4d8b-b53a-4220b7a455dd tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:04.564889 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ea8e513e-1c9a-4d8b-b53a-4220b7a455dd tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:04.748002 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-94c947f6-1b67-4558-97f5-f584d366346d tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:04.755567 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-94c947f6-1b67-4558-97f5-f584d366346d tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1266 microversion: 2.1 time: 0.216376 Jun 03 10:02:04.756134 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 257/511] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:04 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:04.763397 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-ea8e513e-1c9a-4d8b-b53a-4220b7a455dd tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:04.771374 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-ea8e513e-1c9a-4d8b-b53a-4220b7a455dd tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1735 microversion: 2.1 time: 0.220047 Jun 03 10:02:04.771928 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 255/512] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:04 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1735 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:02:05.773325 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-82580b69-da0c-46ee-b728-7ab1df330cbe tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:05.778963 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-82580b69-da0c-46ee-b728-7ab1df330cbe tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:05.780491 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-82580b69-da0c-46ee-b728-7ab1df330cbe tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:05.780935 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-82580b69-da0c-46ee-b728-7ab1df330cbe tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:05.781691 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-82580b69-da0c-46ee-b728-7ab1df330cbe tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:05.782154 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-82580b69-da0c-46ee-b728-7ab1df330cbe tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:05.789325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-1ffbdd9b-b2e9-4857-866a-492d45fd0ed1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:05.789952 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-1ffbdd9b-b2e9-4857-866a-492d45fd0ed1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:05.797111 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1ffbdd9b-b2e9-4857-866a-492d45fd0ed1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:05.797569 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1ffbdd9b-b2e9-4857-866a-492d45fd0ed1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:05.798365 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1ffbdd9b-b2e9-4857-866a-492d45fd0ed1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:05.798801 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1ffbdd9b-b2e9-4857-866a-492d45fd0ed1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:05.985562 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-82580b69-da0c-46ee-b728-7ab1df330cbe tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:05.991731 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-1ffbdd9b-b2e9-4857-866a-492d45fd0ed1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:06.001354 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-82580b69-da0c-46ee-b728-7ab1df330cbe tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1266 microversion: 2.1 time: 0.224072 Jun 03 10:02:06.001354 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 258/513] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:05 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:06.001620 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-1ffbdd9b-b2e9-4857-866a-492d45fd0ed1 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1735 microversion: 2.1 time: 0.214415 Jun 03 10:02:06.001620 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 256/514] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:05 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1735 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:02:07.012008 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-23aa8c4d-1534-4ebe-b400-8a3084a71678 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:07.012572 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-23aa8c4d-1534-4ebe-b400-8a3084a71678 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:07.017734 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-aba6c68f-1ff2-402a-9f3f-227c978dd8e9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:07.018959 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-23aa8c4d-1534-4ebe-b400-8a3084a71678 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:07.019227 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-aba6c68f-1ff2-402a-9f3f-227c978dd8e9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:07.019383 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-23aa8c4d-1534-4ebe-b400-8a3084a71678 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:07.020151 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-23aa8c4d-1534-4ebe-b400-8a3084a71678 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:07.020579 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-23aa8c4d-1534-4ebe-b400-8a3084a71678 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:07.025839 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-aba6c68f-1ff2-402a-9f3f-227c978dd8e9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:07.026323 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-aba6c68f-1ff2-402a-9f3f-227c978dd8e9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:07.027163 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-aba6c68f-1ff2-402a-9f3f-227c978dd8e9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:07.027605 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-aba6c68f-1ff2-402a-9f3f-227c978dd8e9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:07.216991 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-23aa8c4d-1534-4ebe-b400-8a3084a71678 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:07.224558 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-23aa8c4d-1534-4ebe-b400-8a3084a71678 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1266 microversion: 2.1 time: 0.217731 Jun 03 10:02:07.224690 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-aba6c68f-1ff2-402a-9f3f-227c978dd8e9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:07.225134 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 259/515] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:07 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:07.234063 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-aba6c68f-1ff2-402a-9f3f-227c978dd8e9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1735 microversion: 2.1 time: 0.221162 Jun 03 10:02:07.235137 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 257/516] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:07 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1735 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:02:08.242502 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-d7d68260-6886-4ed1-a9cf-f875251cb457 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:08.243390 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-d7d68260-6886-4ed1-a9cf-f875251cb457 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:08.249872 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d7d68260-6886-4ed1-a9cf-f875251cb457 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:08.250350 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d7d68260-6886-4ed1-a9cf-f875251cb457 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:08.251117 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d7d68260-6886-4ed1-a9cf-f875251cb457 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:08.251244 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-8f5f1ef7-a499-44c8-be2f-a06ce55c0d87 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:08.251675 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d7d68260-6886-4ed1-a9cf-f875251cb457 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:08.251848 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-8f5f1ef7-a499-44c8-be2f-a06ce55c0d87 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:08.258672 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8f5f1ef7-a499-44c8-be2f-a06ce55c0d87 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:08.296695 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8f5f1ef7-a499-44c8-be2f-a06ce55c0d87 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:08.296695 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8f5f1ef7-a499-44c8-be2f-a06ce55c0d87 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:08.296695 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8f5f1ef7-a499-44c8-be2f-a06ce55c0d87 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:08.715029 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-d7d68260-6886-4ed1-a9cf-f875251cb457 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:08.718570 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-8f5f1ef7-a499-44c8-be2f-a06ce55c0d87 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:08.726762 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-8f5f1ef7-a499-44c8-be2f-a06ce55c0d87 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1735 microversion: 2.1 time: 0.479357 Jun 03 10:02:08.728327 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 258/517] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:08 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1735 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:02:08.730322 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-d7d68260-6886-4ed1-a9cf-f875251cb457 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1266 microversion: 2.1 time: 0.491573 Jun 03 10:02:08.730910 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 260/518] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:08 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1266 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:09.122043 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-11deeef8-4457-46af-820b-53564b06315b tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:09.122562 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-11deeef8-4457-46af-820b-53564b06315b tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: dce70d56-25df-45f6-b6cc-6c97ca1ae107] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:09.128857 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-11deeef8-4457-46af-820b-53564b06315b tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:09.129271 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-11deeef8-4457-46af-820b-53564b06315b tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:09.130072 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-11deeef8-4457-46af-820b-53564b06315b tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:09.130506 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-11deeef8-4457-46af-820b-53564b06315b tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:09.253084 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.objects.instance [None req-11deeef8-4457-46af-820b-53564b06315b tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lazy-loading 'services' on Instance uuid dce70d56-25df-45f6-b6cc-6c97ca1ae107 {{(pid=125065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:02:09.525756 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-11deeef8-4457-46af-820b-53564b06315b tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107/os-volume_attachments/4957a648-29a9-48d1-a0d4-678b5866f51e" status: 202 len: 0 microversion: 2.1 time: 0.408176 Jun 03 10:02:09.526430 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 259/519] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jun 3 10:02:09 2022] DELETE /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107/os-volume_attachments/4957a648-29a9-48d1-a0d4-678b5866f51e => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:02:09.743743 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-9a6bf9d9-a22e-4c42-a0f6-77460218ae95 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:09.744497 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-9a6bf9d9-a22e-4c42-a0f6-77460218ae95 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:09.746773 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-d70f64fa-aee7-4172-adbd-2e43991ccb8b tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:09.747566 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-d70f64fa-aee7-4172-adbd-2e43991ccb8b tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:09.754172 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9a6bf9d9-a22e-4c42-a0f6-77460218ae95 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:09.754172 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9a6bf9d9-a22e-4c42-a0f6-77460218ae95 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:09.754172 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9a6bf9d9-a22e-4c42-a0f6-77460218ae95 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:09.754172 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9a6bf9d9-a22e-4c42-a0f6-77460218ae95 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:09.754637 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d70f64fa-aee7-4172-adbd-2e43991ccb8b tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:09.754637 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d70f64fa-aee7-4172-adbd-2e43991ccb8b tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:09.755487 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d70f64fa-aee7-4172-adbd-2e43991ccb8b tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:09.755939 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d70f64fa-aee7-4172-adbd-2e43991ccb8b tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:09.948891 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-9a6bf9d9-a22e-4c42-a0f6-77460218ae95 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:09.956953 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-9a6bf9d9-a22e-4c42-a0f6-77460218ae95 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1715 microversion: 2.1 time: 0.217030 Jun 03 10:02:09.957616 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 261/520] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:09 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1715 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:09.962981 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-d70f64fa-aee7-4172-adbd-2e43991ccb8b tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:09.970599 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-d70f64fa-aee7-4172-adbd-2e43991ccb8b tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1266 microversion: 2.1 time: 0.228094 Jun 03 10:02:09.981927 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 260/521] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:09 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:02:10.060074 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-a41dbfa3-3871-4fff-94fe-7f73fcaa6715 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:10.060571 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-a41dbfa3-3871-4fff-94fe-7f73fcaa6715 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:10.066609 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a41dbfa3-3871-4fff-94fe-7f73fcaa6715 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:10.067065 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a41dbfa3-3871-4fff-94fe-7f73fcaa6715 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:10.067833 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a41dbfa3-3871-4fff-94fe-7f73fcaa6715 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:10.068276 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a41dbfa3-3871-4fff-94fe-7f73fcaa6715 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:10.146539 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.wsgi [None req-a41dbfa3-3871-4fff-94fe-7f73fcaa6715 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] HTTP exception thrown: Cannot 'detach_volume' instance 5809214c-e01c-4ff2-adbf-097cf27a9846 while it is in vm_state rescued Jun 03 10:02:10.148139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-a41dbfa3-3871-4fff-94fe-7f73fcaa6715 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Request method failure captured: Jun 03 10:02:10.148139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: request: DELETE /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846/os-volume_attachments/b142ba7a-2b86-4787-a88e-4dc3d25cbf03 HTTP/1.1 Jun 03 10:02:10.148139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept: application/json Jun 03 10:02:10.148139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept-Encoding: identity Jun 03 10:02:10.148139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Connection: close Jun 03 10:02:10.148139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Length: 0 Jun 03 10:02:10.148139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Type: application/json Jun 03 10:02:10.148139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Host: 10.222.0.42 Jun 03 10:02:10.148139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Openstack-System-Scope: None Jun 03 10:02:10.148139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: User-Agent: python-urllib3/1.26.9 Jun 03 10:02:10.148139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Auth-Token: gAAAAABimds_lF-taAYQo6OqoH0o0qi_k4NNuMaAcWJ32OQUNw2FlKeLvYNXSQEH9BN_rrTQvUY_gre2GoIt-GajpX5LOw35Rcbqj_XeR_tQGE2UjgXtf1IV-n56Dfe8ZzhxcJSCI1WvNiH6DeAg_ruh1xJPuTtCWLGR6KAI-13SXw4-Q7nABOE Jun 03 10:02:10.148139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Id: None Jun 03 10:02:10.148139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Name: None Jun 03 10:02:10.148139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Identity-Status: Confirmed Jun 03 10:02:10.148139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Is-Admin-Project: True Jun 03 10:02:10.148139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Id: default Jun 03 10:02:10.148139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Name: Default Jun 03 10:02:10.148139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Id: 071b399988474af1a1c709aac97c1744 Jun 03 10:02:10.148139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1884263324 Jun 03 10:02:10.148139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Role: member,reader Jun 03 10:02:10.148139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Roles: member,reader Jun 03 10:02:10.149743 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/071b399988474af1a1c709aac97c1744"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/071b399988474af1a1c709aac97c1744"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_071b399988474af1a1c709aac97c1744", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/071b399988474af1a1c709aac97c1744"}]}] Jun 03 10:02:10.149743 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1884263324 Jun 03 10:02:10.149743 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Id: 071b399988474af1a1c709aac97c1744 Jun 03 10:02:10.149743 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1884263324 Jun 03 10:02:10.149743 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User: tempest-ServerRescueNegativeTestJSON-1884263324-project Jun 03 10:02:10.149743 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Id: default Jun 03 10:02:10.149743 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Name: Default Jun 03 10:02:10.149743 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Id: 6113d715500240098217caf641db763a Jun 03 10:02:10.149743 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1884263324-project Jun 03 10:02:10.149743 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: method: > Jun 03 10:02:10.149743 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: exception: Cannot 'detach_volume' instance 5809214c-e01c-4ff2-adbf-097cf27a9846 while it is in vm_state rescued Jun 03 10:02:10.152333 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: action_args: {'server_id': '5809214c-e01c-4ff2-adbf-097cf27a9846', 'id': 'b142ba7a-2b86-4787-a88e-4dc3d25cbf03'} Jun 03 10:02:10.152333 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:02:10.152333 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:02:10.152333 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 03 10:02:10.152333 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 03 10:02:10.152333 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 03 10:02:10.152333 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 03 10:02:10.152333 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 03 10:02:10.152333 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 03 10:02:10.152333 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5809214c-e01c-4ff2-adbf-097cf27a9846 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 03 10:02:10.152333 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:02:10.152333 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:02:10.152333 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:02:10.152333 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:02:10.152333 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:02:10.152333 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:02:10.152333 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:02:10.152333 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:02:10.152333 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:02:10.152333 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:02:10.153808 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 03 10:02:10.153808 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 03 10:02:10.153808 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 03 10:02:10.153808 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 03 10:02:10.153808 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 5809214c-e01c-4ff2-adbf-097cf27a9846 while it is in vm_state rescued Jun 03 10:02:10.153808 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:02:10.153808 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:02:10.153808 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:02:10.153808 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:02:10.153808 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:02:10.153808 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:02:10.153808 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:02:10.153808 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:02:10.153808 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 5809214c-e01c-4ff2-adbf-097cf27a9846 while it is in vm_state rescued Jun 03 10:02:10.153808 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:02:10.153808 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-a41dbfa3-3871-4fff-94fe-7f73fcaa6715 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Returning 409 to user: Cannot 'detach_volume' instance 5809214c-e01c-4ff2-adbf-097cf27a9846 while it is in vm_state rescued {{(pid=125066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:02:10.154949 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-a41dbfa3-3871-4fff-94fe-7f73fcaa6715 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846/os-volume_attachments/b142ba7a-2b86-4787-a88e-4dc3d25cbf03" status: 409 len: 152 microversion: 2.1 time: 0.094503 Jun 03 10:02:10.154949 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 262/522] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jun 3 10:02:10 2022] DELETE /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846/os-volume_attachments/b142ba7a-2b86-4787-a88e-4dc3d25cbf03 => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 03 10:02:10.158828 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-873f9c73-f1cb-4caa-8585-ca0a817557e0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:10.159359 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-873f9c73-f1cb-4caa-8585-ca0a817557e0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:10.165292 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-873f9c73-f1cb-4caa-8585-ca0a817557e0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:10.166310 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-873f9c73-f1cb-4caa-8585-ca0a817557e0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:10.167075 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-873f9c73-f1cb-4caa-8585-ca0a817557e0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:10.167533 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-873f9c73-f1cb-4caa-8585-ca0a817557e0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:10.409416 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-873f9c73-f1cb-4caa-8585-ca0a817557e0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "POST /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846/action" status: 202 len: 0 microversion: 2.1 time: 0.254308 Jun 03 10:02:10.410077 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 261/523] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jun 3 10:02:10 2022] POST /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:02:10.418964 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-954401e7-64c5-43f6-b50b-48380535bf12 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:10.419597 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-954401e7-64c5-43f6-b50b-48380535bf12 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:10.425644 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-954401e7-64c5-43f6-b50b-48380535bf12 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:10.426119 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-954401e7-64c5-43f6-b50b-48380535bf12 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:10.426962 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-954401e7-64c5-43f6-b50b-48380535bf12 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:10.427394 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-954401e7-64c5-43f6-b50b-48380535bf12 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:10.564786 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-954401e7-64c5-43f6-b50b-48380535bf12 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:10.576457 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-954401e7-64c5-43f6-b50b-48380535bf12 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1723 microversion: 2.1 time: 0.162104 Jun 03 10:02:10.577364 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 263/524] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:10 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:10.964440 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-0a9d9cad-558d-4513-a1a7-4d5b8c1f917e req-62bdb482-e985-41c3-be6e-84c9a1d09122 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b4620df-63bb-4550-b854-4c81bb1219e0", "name": "network-vif-plugged", "status": "completed", "tag": "9c77efae-7eef-404e-beac-b5252e585eb9"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:10.973375 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-0a9d9cad-558d-4513-a1a7-4d5b8c1f917e req-62bdb482-e985-41c3-be6e-84c9a1d09122 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:10.974964 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-0a9d9cad-558d-4513-a1a7-4d5b8c1f917e req-62bdb482-e985-41c3-be6e-84c9a1d09122 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:10.987022 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-0a9d9cad-558d-4513-a1a7-4d5b8c1f917e req-62bdb482-e985-41c3-be6e-84c9a1d09122 service nova] Creating event network-vif-plugged:9c77efae-7eef-404e-beac-b5252e585eb9 for instance 7b4620df-63bb-4550-b854-4c81bb1219e0 on hv-cinder-84456 Jun 03 10:02:10.993375 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-0a9d9cad-558d-4513-a1a7-4d5b8c1f917e req-62bdb482-e985-41c3-be6e-84c9a1d09122 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033554 Jun 03 10:02:10.994363 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 262/525] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:02:10.997472 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-86daa0ce-ed0c-44ac-9ae0-411242f64f90 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:11.003507 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-86daa0ce-ed0c-44ac-9ae0-411242f64f90 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:11.005734 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-86daa0ce-ed0c-44ac-9ae0-411242f64f90 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:11.006227 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-86daa0ce-ed0c-44ac-9ae0-411242f64f90 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:11.006994 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-86daa0ce-ed0c-44ac-9ae0-411242f64f90 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:11.007431 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-86daa0ce-ed0c-44ac-9ae0-411242f64f90 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:11.196177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-86daa0ce-ed0c-44ac-9ae0-411242f64f90 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:11.205134 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-86daa0ce-ed0c-44ac-9ae0-411242f64f90 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1266 microversion: 2.1 time: 0.212519 Jun 03 10:02:11.209908 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 264/526] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:10 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:11.595927 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-52062e06-7699-4063-9b38-2b750a5a1cfc tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:11.596617 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-52062e06-7699-4063-9b38-2b750a5a1cfc tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:11.602895 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-52062e06-7699-4063-9b38-2b750a5a1cfc tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:11.603343 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-52062e06-7699-4063-9b38-2b750a5a1cfc tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:11.604100 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-52062e06-7699-4063-9b38-2b750a5a1cfc tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:11.604539 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-52062e06-7699-4063-9b38-2b750a5a1cfc tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:11.692456 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-8c3ffb65-a7cd-48af-b931-14f820ecc600 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:11.692976 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-8c3ffb65-a7cd-48af-b931-14f820ecc600 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: dce70d56-25df-45f6-b6cc-6c97ca1ae107] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:11.699734 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8c3ffb65-a7cd-48af-b931-14f820ecc600 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:11.700188 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8c3ffb65-a7cd-48af-b931-14f820ecc600 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:11.700949 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8c3ffb65-a7cd-48af-b931-14f820ecc600 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:11.701389 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8c3ffb65-a7cd-48af-b931-14f820ecc600 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:11.726745 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-8c3ffb65-a7cd-48af-b931-14f820ecc600 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: dce70d56-25df-45f6-b6cc-6c97ca1ae107] Going to try to terminate instance {{(pid=125066) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:02:11.737130 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-52062e06-7699-4063-9b38-2b750a5a1cfc tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:11.745427 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-52062e06-7699-4063-9b38-2b750a5a1cfc tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1723 microversion: 2.1 time: 0.154253 Jun 03 10:02:11.746024 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 263/527] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:11 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:11.849909 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:12.057707 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-8c3ffb65-a7cd-48af-b931-14f820ecc600 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107" status: 204 len: 0 microversion: 2.1 time: 0.368792 Jun 03 10:02:12.058390 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 265/528] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 3 10:02:11 2022] DELETE /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 03 10:02:12.066365 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-4b0d4e43-41a1-44ce-a6c9-1170466b7609 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:12.066976 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-4b0d4e43-41a1-44ce-a6c9-1170466b7609 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: dce70d56-25df-45f6-b6cc-6c97ca1ae107] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:12.073832 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4b0d4e43-41a1-44ce-a6c9-1170466b7609 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:12.077709 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4b0d4e43-41a1-44ce-a6c9-1170466b7609 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:12.077709 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4b0d4e43-41a1-44ce-a6c9-1170466b7609 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:12.077709 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4b0d4e43-41a1-44ce-a6c9-1170466b7609 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:12.204909 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-4b0d4e43-41a1-44ce-a6c9-1170466b7609 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:12.212420 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-4b0d4e43-41a1-44ce-a6c9-1170466b7609 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107" status: 200 len: 1513 microversion: 2.1 time: 0.149901 Jun 03 10:02:12.212990 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 264/529] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:12 2022] GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:12.223885 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-9cf2ce34-91f4-4e62-bf36-86acbe06a9d3 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:12.224594 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-9cf2ce34-91f4-4e62-bf36-86acbe06a9d3 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:12.230594 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9cf2ce34-91f4-4e62-bf36-86acbe06a9d3 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:12.231039 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9cf2ce34-91f4-4e62-bf36-86acbe06a9d3 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:12.231787 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9cf2ce34-91f4-4e62-bf36-86acbe06a9d3 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:12.232216 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9cf2ce34-91f4-4e62-bf36-86acbe06a9d3 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:12.360576 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-9cf2ce34-91f4-4e62-bf36-86acbe06a9d3 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:12.368407 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-9cf2ce34-91f4-4e62-bf36-86acbe06a9d3 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1266 microversion: 2.1 time: 0.148723 Jun 03 10:02:12.369521 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 266/530] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:12 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:02:12.762864 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-6294680f-5853-485e-be2b-6def766382a8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:12.763471 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-6294680f-5853-485e-be2b-6def766382a8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:12.770199 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6294680f-5853-485e-be2b-6def766382a8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:12.770695 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6294680f-5853-485e-be2b-6def766382a8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:12.771447 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6294680f-5853-485e-be2b-6def766382a8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:12.771875 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6294680f-5853-485e-be2b-6def766382a8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:12.912467 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-6294680f-5853-485e-be2b-6def766382a8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:12.920997 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-6294680f-5853-485e-be2b-6def766382a8 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1723 microversion: 2.1 time: 0.162318 Jun 03 10:02:12.921558 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 265/531] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:12 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:13.230303 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-b6d6d3da-1e40-46f9-a388-969ba40289a5 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:13.230943 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-b6d6d3da-1e40-46f9-a388-969ba40289a5 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: dce70d56-25df-45f6-b6cc-6c97ca1ae107] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:13.237467 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b6d6d3da-1e40-46f9-a388-969ba40289a5 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:13.237955 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b6d6d3da-1e40-46f9-a388-969ba40289a5 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:13.238710 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b6d6d3da-1e40-46f9-a388-969ba40289a5 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:13.239141 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b6d6d3da-1e40-46f9-a388-969ba40289a5 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:13.364612 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-b6d6d3da-1e40-46f9-a388-969ba40289a5 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:13.372755 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-b6d6d3da-1e40-46f9-a388-969ba40289a5 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107" status: 200 len: 1513 microversion: 2.1 time: 0.146913 Jun 03 10:02:13.373405 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 267/532] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:13 2022] GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107 => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:13.384604 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-462d66a9-fede-426b-9325-7ff8b9c381d7 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:13.385456 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-462d66a9-fede-426b-9325-7ff8b9c381d7 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:13.391501 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-462d66a9-fede-426b-9325-7ff8b9c381d7 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:13.391941 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-462d66a9-fede-426b-9325-7ff8b9c381d7 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:13.392690 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-462d66a9-fede-426b-9325-7ff8b9c381d7 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:13.393116 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-462d66a9-fede-426b-9325-7ff8b9c381d7 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:13.521309 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-462d66a9-fede-426b-9325-7ff8b9c381d7 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:13.528931 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-462d66a9-fede-426b-9325-7ff8b9c381d7 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1266 microversion: 2.1 time: 0.148157 Jun 03 10:02:13.529603 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 266/533] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:13 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:13.938009 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-20549113-b19d-4670-9b05-eec95d56bdf0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:13.938618 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-20549113-b19d-4670-9b05-eec95d56bdf0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:13.944644 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-20549113-b19d-4670-9b05-eec95d56bdf0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:13.945093 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-20549113-b19d-4670-9b05-eec95d56bdf0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:13.945844 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-20549113-b19d-4670-9b05-eec95d56bdf0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:13.946303 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-20549113-b19d-4670-9b05-eec95d56bdf0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:14.075067 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-20549113-b19d-4670-9b05-eec95d56bdf0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:14.083170 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-20549113-b19d-4670-9b05-eec95d56bdf0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1723 microversion: 2.1 time: 0.149091 Jun 03 10:02:14.083898 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 268/534] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:13 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:14.390984 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-8e3ca383-6b33-4243-aa17-9c10bbac689c tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:14.391587 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-8e3ca383-6b33-4243-aa17-9c10bbac689c tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: dce70d56-25df-45f6-b6cc-6c97ca1ae107] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:14.397717 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8e3ca383-6b33-4243-aa17-9c10bbac689c tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:14.398225 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8e3ca383-6b33-4243-aa17-9c10bbac689c tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:14.398971 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8e3ca383-6b33-4243-aa17-9c10bbac689c tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:14.399397 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8e3ca383-6b33-4243-aa17-9c10bbac689c tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:14.421416 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:14.545584 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-e0ff4902-5e82-46b7-b21e-ef8603f018fc tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:14.546323 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-e0ff4902-5e82-46b7-b21e-ef8603f018fc tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:14.552892 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e0ff4902-5e82-46b7-b21e-ef8603f018fc tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:14.553339 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e0ff4902-5e82-46b7-b21e-ef8603f018fc tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:14.559662 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e0ff4902-5e82-46b7-b21e-ef8603f018fc tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:14.559662 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e0ff4902-5e82-46b7-b21e-ef8603f018fc tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:14.562444 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-8e3ca383-6b33-4243-aa17-9c10bbac689c tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:14.569773 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-8e3ca383-6b33-4243-aa17-9c10bbac689c tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107" status: 200 len: 1513 microversion: 2.1 time: 0.183597 Jun 03 10:02:14.570617 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 267/535] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:14 2022] GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107 => generated 1513 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:02:14.666412 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-092d64b8-9f12-4789-b9b2-6a783b3794bf tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-675529665", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2115358546", "security_groups": [{"name": "tempest-secgroup-smoke-1967791514"}], "networks": [{"uuid": "01385250-2fd5-4d81-b043-bc8409277f05"}], "block_device_mapping_v2": [{"uuid": "2726df8d-e1ca-48fb-bca3-a185514bf1e4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:14.727562 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-e0ff4902-5e82-46b7-b21e-ef8603f018fc tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:14.735815 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-e0ff4902-5e82-46b7-b21e-ef8603f018fc tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1266 microversion: 2.1 time: 0.194517 Jun 03 10:02:14.736378 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 269/536] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:14 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:02:14.800705 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.network.neutron [None req-092d64b8-9f12-4789-b9b2-6a783b3794bf tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] validate_networks() for [('01385250-2fd5-4d81-b043-bc8409277f05', None, None, None, None, None)] {{(pid=125065) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 10:02:15.099879 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-b4427883-b2cd-4286-87f5-4d7ed972b3fd tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:15.100485 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-b4427883-b2cd-4286-87f5-4d7ed972b3fd tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:15.106524 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b4427883-b2cd-4286-87f5-4d7ed972b3fd tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:15.106976 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b4427883-b2cd-4286-87f5-4d7ed972b3fd tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:15.107741 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b4427883-b2cd-4286-87f5-4d7ed972b3fd tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:15.108271 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b4427883-b2cd-4286-87f5-4d7ed972b3fd tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:15.213085 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-092d64b8-9f12-4789-b9b2-6a783b3794bf tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Flavor limits 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 10:02:15.213531 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-092d64b8-9f12-4789-b9b2-6a783b3794bf tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Image limits 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 10:02:15.214033 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-092d64b8-9f12-4789-b9b2-6a783b3794bf tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Flavor pref 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 10:02:15.214445 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-092d64b8-9f12-4789-b9b2-6a783b3794bf tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Image pref 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 10:02:15.214917 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-092d64b8-9f12-4789-b9b2-6a783b3794bf tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 10:02:15.223848 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-092d64b8-9f12-4789-b9b2-6a783b3794bf tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:15.224330 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-092d64b8-9f12-4789-b9b2-6a783b3794bf tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:15.225133 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-092d64b8-9f12-4789-b9b2-6a783b3794bf tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:15.225567 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-092d64b8-9f12-4789-b9b2-6a783b3794bf tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:15.243362 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.quota [None req-092d64b8-9f12-4789-b9b2-6a783b3794bf tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Getting quotas for project 3c44b2575d1945e0a100fe081e5af582. Resources: {'ram', 'instances', 'cores'} {{(pid=125065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:02:15.247887 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.quota [None req-092d64b8-9f12-4789-b9b2-6a783b3794bf tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Getting quotas for user 5d332241d6f84959880bfa99a24805dc and project 3c44b2575d1945e0a100fe081e5af582. Resources: {'ram', 'instances', 'cores'} {{(pid=125065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:02:15.257016 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-b4427883-b2cd-4286-87f5-4d7ed972b3fd tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:15.266480 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-b4427883-b2cd-4286-87f5-4d7ed972b3fd tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1729 microversion: 2.1 time: 0.170253 Jun 03 10:02:15.267058 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 270/537] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:15 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:02:15.282688 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-571fd688-1e25-4bd8-a368-1c2c721dfb7a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:15.286347 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-571fd688-1e25-4bd8-a368-1c2c721dfb7a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:15.289261 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-571fd688-1e25-4bd8-a368-1c2c721dfb7a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:15.289716 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-571fd688-1e25-4bd8-a368-1c2c721dfb7a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:15.291055 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-571fd688-1e25-4bd8-a368-1c2c721dfb7a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:15.291489 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-571fd688-1e25-4bd8-a368-1c2c721dfb7a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:15.307498 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-092d64b8-9f12-4789-b9b2-6a783b3794bf tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Going to run 1 instances... {{(pid=125065) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 10:02:15.308903 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-092d64b8-9f12-4789-b9b2-6a783b3794bf tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2726df8d-e1ca-48fb-bca3-a185514bf1e4',volume_size=None,volume_type=None)] {{(pid=125065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 10:02:15.371668 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-571fd688-1e25-4bd8-a368-1c2c721dfb7a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092841 Jun 03 10:02:15.372611 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 271/538] 10.222.0.42 () {58 vars in 1274 bytes} [Fri Jun 3 10:02:15 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:02:15.588313 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-658935ed-22b9-4ae9-85d5-2775807acddf tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:15.588945 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-658935ed-22b9-4ae9-85d5-2775807acddf tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: dce70d56-25df-45f6-b6cc-6c97ca1ae107] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:15.594990 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-658935ed-22b9-4ae9-85d5-2775807acddf tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:15.595475 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-658935ed-22b9-4ae9-85d5-2775807acddf tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:15.596236 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-658935ed-22b9-4ae9-85d5-2775807acddf tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:15.596668 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-658935ed-22b9-4ae9-85d5-2775807acddf tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:15.791613 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-092d64b8-9f12-4789-b9b2-6a783b3794bf tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.132220 Jun 03 10:02:15.792664 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 268/539] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 3 10:02:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 1134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 10:02:15.797719 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-87abd96c-88e5-4406-8f2d-140b0fc013bc tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:15.798417 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-87abd96c-88e5-4406-8f2d-140b0fc013bc tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:15.806674 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-87abd96c-88e5-4406-8f2d-140b0fc013bc tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:15.807305 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-87abd96c-88e5-4406-8f2d-140b0fc013bc tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:15.808090 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-87abd96c-88e5-4406-8f2d-140b0fc013bc tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:15.808543 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-87abd96c-88e5-4406-8f2d-140b0fc013bc tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:15.919768 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-658935ed-22b9-4ae9-85d5-2775807acddf tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:15.929256 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-658935ed-22b9-4ae9-85d5-2775807acddf tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107" status: 200 len: 1513 microversion: 2.1 time: 0.345233 Jun 03 10:02:15.938954 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 272/540] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:15 2022] GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107 => generated 1513 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:02:15.938954 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-1247fa9d-08db-4ef6-942e-4e20be50873b tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:15.938954 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-1247fa9d-08db-4ef6-942e-4e20be50873b tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:16.039757 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-1247fa9d-08db-4ef6-942e-4e20be50873b tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:16.046707 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-1247fa9d-08db-4ef6-942e-4e20be50873b tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1088 microversion: 2.1 time: 0.115792 Jun 03 10:02:16.047283 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 273/541] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:15 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1088 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:16.217275 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-87abd96c-88e5-4406-8f2d-140b0fc013bc tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:16.225014 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-87abd96c-88e5-4406-8f2d-140b0fc013bc tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1266 microversion: 2.1 time: 0.431246 Jun 03 10:02:16.225909 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 269/542] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:15 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1266 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:16.946010 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-47365c19-3683-4a1a-9110-8acc1d7e40ab tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:16.946620 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-47365c19-3683-4a1a-9110-8acc1d7e40ab tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: dce70d56-25df-45f6-b6cc-6c97ca1ae107] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:16.954540 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-47365c19-3683-4a1a-9110-8acc1d7e40ab tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:16.955193 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-47365c19-3683-4a1a-9110-8acc1d7e40ab tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:16.956280 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-47365c19-3683-4a1a-9110-8acc1d7e40ab tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:16.956545 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-47365c19-3683-4a1a-9110-8acc1d7e40ab tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:16.973719 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-39887380-172e-4cd1-bad6-dfd28e6d819f req-208e9345-200d-4703-9193-d351356e843e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dce70d56-25df-45f6-b6cc-6c97ca1ae107", "name": "network-vif-deleted", "tag": "a2d8efb0-adea-4506-ba70-c181d5230749"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:16.984376 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-39887380-172e-4cd1-bad6-dfd28e6d819f req-208e9345-200d-4703-9193-d351356e843e service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:16.985423 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-39887380-172e-4cd1-bad6-dfd28e6d819f req-208e9345-200d-4703-9193-d351356e843e service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:16.999077 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-39887380-172e-4cd1-bad6-dfd28e6d819f req-208e9345-200d-4703-9193-d351356e843e service nova] Creating event network-vif-deleted:a2d8efb0-adea-4506-ba70-c181d5230749 for instance dce70d56-25df-45f6-b6cc-6c97ca1ae107 on hv-cinder-84456 Jun 03 10:02:17.004191 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-39887380-172e-4cd1-bad6-dfd28e6d819f req-208e9345-200d-4703-9193-d351356e843e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037575 Jun 03 10:02:17.005059 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 270/543] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:02:17.053711 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-47365c19-3683-4a1a-9110-8acc1d7e40ab tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:17.064458 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-47365c19-3683-4a1a-9110-8acc1d7e40ab tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107" status: 200 len: 1471 microversion: 2.1 time: 0.122419 Jun 03 10:02:17.068678 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-a4587fea-2c53-4467-8c84-d542a599ed6b tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:17.069271 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 274/544] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:16 2022] GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107 => generated 1471 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:17.069948 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-a4587fea-2c53-4467-8c84-d542a599ed6b tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:17.139932 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-a4587fea-2c53-4467-8c84-d542a599ed6b tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:17.146967 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-a4587fea-2c53-4467-8c84-d542a599ed6b tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1088 microversion: 2.1 time: 0.085207 Jun 03 10:02:17.147941 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 271/545] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:17 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1088 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:17.242106 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-22db4871-2f88-48a4-91b3-65cebdff7dbf tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:17.249276 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-22db4871-2f88-48a4-91b3-65cebdff7dbf tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:17.250400 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-22db4871-2f88-48a4-91b3-65cebdff7dbf tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:17.250943 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-22db4871-2f88-48a4-91b3-65cebdff7dbf tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:17.251777 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-22db4871-2f88-48a4-91b3-65cebdff7dbf tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:17.252303 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-22db4871-2f88-48a4-91b3-65cebdff7dbf tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:17.388744 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-22db4871-2f88-48a4-91b3-65cebdff7dbf tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:17.396260 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-22db4871-2f88-48a4-91b3-65cebdff7dbf tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1452 microversion: 2.1 time: 0.158075 Jun 03 10:02:17.396832 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 275/546] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:17 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:17.413014 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-9b24f435-3f5f-40a5-aec9-c6258557a7ca tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:17.413622 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-9b24f435-3f5f-40a5-aec9-c6258557a7ca tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:17.420481 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9b24f435-3f5f-40a5-aec9-c6258557a7ca tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:17.426799 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9b24f435-3f5f-40a5-aec9-c6258557a7ca tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:17.426799 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9b24f435-3f5f-40a5-aec9-c6258557a7ca tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:17.426799 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9b24f435-3f5f-40a5-aec9-c6258557a7ca tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:17.553730 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-9b24f435-3f5f-40a5-aec9-c6258557a7ca tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:17.562282 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-9b24f435-3f5f-40a5-aec9-c6258557a7ca tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1452 microversion: 2.1 time: 0.153159 Jun 03 10:02:17.565188 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 272/547] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:17 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:18.086353 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-dfbcdd92-92ce-4e36-bedd-913aab3e6c7a tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:18.086995 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-dfbcdd92-92ce-4e36-bedd-913aab3e6c7a tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: dce70d56-25df-45f6-b6cc-6c97ca1ae107] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:18.093600 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-dfbcdd92-92ce-4e36-bedd-913aab3e6c7a tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:18.094577 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-dfbcdd92-92ce-4e36-bedd-913aab3e6c7a tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:18.094836 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-dfbcdd92-92ce-4e36-bedd-913aab3e6c7a tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:18.095269 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-dfbcdd92-92ce-4e36-bedd-913aab3e6c7a tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:18.127285 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-dfbcdd92-92ce-4e36-bedd-913aab3e6c7a tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:18.127728 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-dfbcdd92-92ce-4e36-bedd-913aab3e6c7a tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:18.128171 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.objects.instance [None req-dfbcdd92-92ce-4e36-bedd-913aab3e6c7a tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lazy-loading 'fault' on Instance uuid dce70d56-25df-45f6-b6cc-6c97ca1ae107 {{(pid=125066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:02:18.165161 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-0d83eedd-7461-4905-a3fc-280981ae3b8e tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:18.165876 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-0d83eedd-7461-4905-a3fc-280981ae3b8e tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:18.173359 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0d83eedd-7461-4905-a3fc-280981ae3b8e tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:18.173841 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0d83eedd-7461-4905-a3fc-280981ae3b8e tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:18.174639 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-dfbcdd92-92ce-4e36-bedd-913aab3e6c7a tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:18.174823 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0d83eedd-7461-4905-a3fc-280981ae3b8e tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:18.175431 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0d83eedd-7461-4905-a3fc-280981ae3b8e tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:18.183003 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-dfbcdd92-92ce-4e36-bedd-913aab3e6c7a tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107" status: 200 len: 1308 microversion: 2.1 time: 0.100582 Jun 03 10:02:18.192851 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 276/548] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:18 2022] GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107 => generated 1308 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:18.241673 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-0d83eedd-7461-4905-a3fc-280981ae3b8e tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:18.249288 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-0d83eedd-7461-4905-a3fc-280981ae3b8e tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1186 microversion: 2.1 time: 0.088460 Jun 03 10:02:18.249915 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 273/549] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:18 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1186 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:19.054554 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-a52e1a36-a0b2-406c-a86c-e4dcef77b4b3 req-55b26cdd-3aaf-424c-85f4-6aceeba81410 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5809214c-e01c-4ff2-adbf-097cf27a9846", "tag": "fce52c81-17cf-4133-980e-d0dda0f0288a"}, {"name": "network-changed", "server_uuid": "5809214c-e01c-4ff2-adbf-097cf27a9846", "tag": "fce52c81-17cf-4133-980e-d0dda0f0288a"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:19.063872 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-a52e1a36-a0b2-406c-a86c-e4dcef77b4b3 req-55b26cdd-3aaf-424c-85f4-6aceeba81410 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:19.064319 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-a52e1a36-a0b2-406c-a86c-e4dcef77b4b3 req-55b26cdd-3aaf-424c-85f4-6aceeba81410 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:19.079292 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-a52e1a36-a0b2-406c-a86c-e4dcef77b4b3 req-55b26cdd-3aaf-424c-85f4-6aceeba81410 service nova] Creating event network-changed:fce52c81-17cf-4133-980e-d0dda0f0288a for instance 5809214c-e01c-4ff2-adbf-097cf27a9846 on hv-cinder-84456 Jun 03 10:02:19.079801 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-a52e1a36-a0b2-406c-a86c-e4dcef77b4b3 req-55b26cdd-3aaf-424c-85f4-6aceeba81410 service nova] Creating event network-changed:fce52c81-17cf-4133-980e-d0dda0f0288a for instance 5809214c-e01c-4ff2-adbf-097cf27a9846 on hv-cinder-84456 Jun 03 10:02:19.085096 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-a52e1a36-a0b2-406c-a86c-e4dcef77b4b3 req-55b26cdd-3aaf-424c-85f4-6aceeba81410 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035625 Jun 03 10:02:19.085685 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 277/550] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:02:19.200609 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-1c67db6d-34b4-40fa-b1bf-34b68278bdd2 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:19.202401 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-1c67db6d-34b4-40fa-b1bf-34b68278bdd2 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: dce70d56-25df-45f6-b6cc-6c97ca1ae107] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:19.210311 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1c67db6d-34b4-40fa-b1bf-34b68278bdd2 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:19.210758 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1c67db6d-34b4-40fa-b1bf-34b68278bdd2 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:19.211903 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1c67db6d-34b4-40fa-b1bf-34b68278bdd2 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:19.212651 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1c67db6d-34b4-40fa-b1bf-34b68278bdd2 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:19.227606 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.wsgi [None req-1c67db6d-34b4-40fa-b1bf-34b68278bdd2 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] HTTP exception thrown: Instance dce70d56-25df-45f6-b6cc-6c97ca1ae107 could not be found. Jun 03 10:02:19.230144 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-1c67db6d-34b4-40fa-b1bf-34b68278bdd2 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Request method failure captured: Jun 03 10:02:19.230144 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: request: GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107 HTTP/1.1 Jun 03 10:02:19.230144 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept: application/json Jun 03 10:02:19.230144 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept-Encoding: identity Jun 03 10:02:19.230144 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Connection: close Jun 03 10:02:19.230144 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Length: 0 Jun 03 10:02:19.230144 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Type: application/json Jun 03 10:02:19.230144 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Host: 10.222.0.42 Jun 03 10:02:19.230144 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Openstack-System-Scope: None Jun 03 10:02:19.230144 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: User-Agent: python-urllib3/1.26.9 Jun 03 10:02:19.230144 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Auth-Token: gAAAAABimdvSN6tTFxhhZ3m7xo_krfPkVg5RoM16R-LG76cABjpqpd8tmEAbWX8Z47fTMHbUjXKsXu9kB7BeTeJcbJvBjsrDMK1iDXgDjx50mEUZ4gFeAhV5wTBeUFdggVtt36m6wwWZvVj7GiNpkxTGXl0xqnqdGXF51vXVOI5h0ZQtBCklg9s Jun 03 10:02:19.230144 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Id: None Jun 03 10:02:19.230144 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Name: None Jun 03 10:02:19.230144 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Identity-Status: Confirmed Jun 03 10:02:19.230144 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Is-Admin-Project: True Jun 03 10:02:19.230144 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Id: default Jun 03 10:02:19.230144 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Name: Default Jun 03 10:02:19.230144 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Id: 6a0f8d737269433bb6ce1baf51b8157b Jun 03 10:02:19.230144 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Name: tempest-VolumesSnapshotTestJSON-959706326 Jun 03 10:02:19.230144 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Role: member,reader Jun 03 10:02:19.230144 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Roles: member,reader Jun 03 10:02:19.231433 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6a0f8d737269433bb6ce1baf51b8157b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6a0f8d737269433bb6ce1baf51b8157b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6a0f8d737269433bb6ce1baf51b8157b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6a0f8d737269433bb6ce1baf51b8157b"}]}] Jun 03 10:02:19.231433 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant: tempest-VolumesSnapshotTestJSON-959706326 Jun 03 10:02:19.231433 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Id: 6a0f8d737269433bb6ce1baf51b8157b Jun 03 10:02:19.231433 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-959706326 Jun 03 10:02:19.231433 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User: tempest-VolumesSnapshotTestJSON-959706326-project Jun 03 10:02:19.231433 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Id: default Jun 03 10:02:19.231433 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Name: Default Jun 03 10:02:19.231433 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Id: 82621df465a640b28eb955733ceda02f Jun 03 10:02:19.231433 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Name: tempest-VolumesSnapshotTestJSON-959706326-project Jun 03 10:02:19.231433 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: method: > Jun 03 10:02:19.231433 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: exception: Instance dce70d56-25df-45f6-b6cc-6c97ca1ae107 could not be found. Jun 03 10:02:19.231433 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: action_args: {'id': 'dce70d56-25df-45f6-b6cc-6c97ca1ae107'} Jun 03 10:02:19.232610 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:02:19.232610 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:02:19.232610 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:02:19.232610 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:02:19.232610 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:02:19.232610 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:02:19.232610 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:02:19.232610 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:02:19.232610 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:02:19.232610 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:02:19.232610 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dce70d56-25df-45f6-b6cc-6c97ca1ae107 could not be found. Jun 03 10:02:19.232610 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:02:19.232610 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:02:19.232610 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:02:19.232610 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:02:19.232610 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:02:19.232610 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:02:19.232610 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:02:19.232610 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:02:19.232610 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:02:19.234535 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:02:19.234535 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:02:19.234535 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:02:19.234535 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:02:19.234535 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:02:19.234535 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:02:19.234535 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:02:19.234535 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dce70d56-25df-45f6-b6cc-6c97ca1ae107 could not be found. Jun 03 10:02:19.234535 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:02:19.234535 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:02:19.234535 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:02:19.234535 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:02:19.234535 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:02:19.234535 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:02:19.234535 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:02:19.234535 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:02:19.234535 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dce70d56-25df-45f6-b6cc-6c97ca1ae107 could not be found. Jun 03 10:02:19.234535 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:02:19.239356 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-1c67db6d-34b4-40fa-b1bf-34b68278bdd2 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Returning 404 to user: Instance dce70d56-25df-45f6-b6cc-6c97ca1ae107 could not be found. {{(pid=125065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:02:19.239356 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-1c67db6d-34b4-40fa-b1bf-34b68278bdd2 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107" status: 404 len: 111 microversion: 2.1 time: 0.035295 Jun 03 10:02:19.239356 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 274/551] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:19 2022] GET /compute/v2.1/servers/dce70d56-25df-45f6-b6cc-6c97ca1ae107 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:02:19.269403 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-d4597e60-9bfc-4fc3-84dc-71c65e7c088c tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:19.271040 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-d4597e60-9bfc-4fc3-84dc-71c65e7c088c tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:19.278976 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d4597e60-9bfc-4fc3-84dc-71c65e7c088c tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:19.280027 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d4597e60-9bfc-4fc3-84dc-71c65e7c088c tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:19.281216 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d4597e60-9bfc-4fc3-84dc-71c65e7c088c tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:19.281785 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d4597e60-9bfc-4fc3-84dc-71c65e7c088c tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:19.401427 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-d4597e60-9bfc-4fc3-84dc-71c65e7c088c tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:19.409626 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-d4597e60-9bfc-4fc3-84dc-71c65e7c088c tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1204 microversion: 2.1 time: 0.145959 Jun 03 10:02:19.410320 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 278/552] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:19 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1204 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:20.013771 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-f5c8f3b1-d5a9-4258-a39e-7baba36616b0 req-ee7cf94c-de12-42d0-9f46-4c5e4d45be9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b4620df-63bb-4550-b854-4c81bb1219e0", "tag": "9c77efae-7eef-404e-beac-b5252e585eb9"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:20.022073 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-f5c8f3b1-d5a9-4258-a39e-7baba36616b0 req-ee7cf94c-de12-42d0-9f46-4c5e4d45be9f service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:20.022526 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-f5c8f3b1-d5a9-4258-a39e-7baba36616b0 req-ee7cf94c-de12-42d0-9f46-4c5e4d45be9f service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:20.035897 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-f5c8f3b1-d5a9-4258-a39e-7baba36616b0 req-ee7cf94c-de12-42d0-9f46-4c5e4d45be9f service nova] Creating event network-changed:9c77efae-7eef-404e-beac-b5252e585eb9 for instance 7b4620df-63bb-4550-b854-4c81bb1219e0 on hv-cinder-84456 Jun 03 10:02:20.041401 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-f5c8f3b1-d5a9-4258-a39e-7baba36616b0 req-ee7cf94c-de12-42d0-9f46-4c5e4d45be9f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031730 Jun 03 10:02:20.042374 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 275/553] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:02:20.427383 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-a14e1c3c-6f2b-423b-bce1-b9708947f302 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:20.427991 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-a14e1c3c-6f2b-423b-bce1-b9708947f302 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:20.434519 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a14e1c3c-6f2b-423b-bce1-b9708947f302 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:20.435757 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a14e1c3c-6f2b-423b-bce1-b9708947f302 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:20.435757 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a14e1c3c-6f2b-423b-bce1-b9708947f302 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:20.436215 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a14e1c3c-6f2b-423b-bce1-b9708947f302 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:20.573200 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-a14e1c3c-6f2b-423b-bce1-b9708947f302 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:20.581416 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-a14e1c3c-6f2b-423b-bce1-b9708947f302 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1272 microversion: 2.1 time: 0.157388 Jun 03 10:02:20.582716 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 279/554] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:20 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1272 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:21.600861 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-41c4fc1b-e371-42c1-8cb4-2309907bd4be tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:21.601561 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-41c4fc1b-e371-42c1-8cb4-2309907bd4be tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:21.607931 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-41c4fc1b-e371-42c1-8cb4-2309907bd4be tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:21.608384 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-41c4fc1b-e371-42c1-8cb4-2309907bd4be tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:21.609144 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-41c4fc1b-e371-42c1-8cb4-2309907bd4be tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:21.609582 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-41c4fc1b-e371-42c1-8cb4-2309907bd4be tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:21.743716 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-41c4fc1b-e371-42c1-8cb4-2309907bd4be tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:21.751792 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-41c4fc1b-e371-42c1-8cb4-2309907bd4be tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1272 microversion: 2.1 time: 0.155683 Jun 03 10:02:21.752539 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 276/555] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:21 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1272 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:22.769823 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-74595cbe-01a3-490a-bbfc-541d45e7eae1 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:22.770457 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-74595cbe-01a3-490a-bbfc-541d45e7eae1 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:22.773213 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:22.806389 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-74595cbe-01a3-490a-bbfc-541d45e7eae1 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:22.806389 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-74595cbe-01a3-490a-bbfc-541d45e7eae1 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:22.806389 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-74595cbe-01a3-490a-bbfc-541d45e7eae1 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:22.806389 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-74595cbe-01a3-490a-bbfc-541d45e7eae1 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:23.133543 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-74595cbe-01a3-490a-bbfc-541d45e7eae1 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:23.141726 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-74595cbe-01a3-490a-bbfc-541d45e7eae1 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1272 microversion: 2.1 time: 0.375853 Jun 03 10:02:23.142522 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 280/556] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:22 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1272 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:24.164951 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-26ec92ae-decc-4d68-a05c-bc286fa2117c tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:24.164951 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-26ec92ae-decc-4d68-a05c-bc286fa2117c tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:24.166425 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-26ec92ae-decc-4d68-a05c-bc286fa2117c tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:24.166747 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-26ec92ae-decc-4d68-a05c-bc286fa2117c tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:24.167970 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-26ec92ae-decc-4d68-a05c-bc286fa2117c tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:24.168551 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-26ec92ae-decc-4d68-a05c-bc286fa2117c tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:24.380706 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-26ec92ae-decc-4d68-a05c-bc286fa2117c tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:24.388694 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-26ec92ae-decc-4d68-a05c-bc286fa2117c tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1260 microversion: 2.1 time: 0.233835 Jun 03 10:02:24.389263 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 277/557] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:24 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1260 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:24.508001 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-4a94aae2-35ac-44d4-a988-3c97c14e89d6 req-85b7337c-3742-4c06-90d1-a404153b6d2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5afad0ea-b328-43cf-8ed2-f500796569b0", "tag": "895de58e-9396-45ee-adb3-b1ce59bb1799"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:24.525564 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-4a94aae2-35ac-44d4-a988-3c97c14e89d6 req-85b7337c-3742-4c06-90d1-a404153b6d2e service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:24.525564 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-4a94aae2-35ac-44d4-a988-3c97c14e89d6 req-85b7337c-3742-4c06-90d1-a404153b6d2e service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:24.532629 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-4a94aae2-35ac-44d4-a988-3c97c14e89d6 req-85b7337c-3742-4c06-90d1-a404153b6d2e service nova] Creating event network-changed:895de58e-9396-45ee-adb3-b1ce59bb1799 for instance 5afad0ea-b328-43cf-8ed2-f500796569b0 on hv-cinder-84456 Jun 03 10:02:24.537632 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-4a94aae2-35ac-44d4-a988-3c97c14e89d6 req-85b7337c-3742-4c06-90d1-a404153b6d2e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033490 Jun 03 10:02:24.538442 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 281/558] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:02:25.406829 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-eade5131-232c-4d4a-a2c8-0e5d6ae5def4 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:25.407444 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-eade5131-232c-4d4a-a2c8-0e5d6ae5def4 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:25.409843 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell0:SELECT=2 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:25.414718 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-eade5131-232c-4d4a-a2c8-0e5d6ae5def4 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:25.415225 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-eade5131-232c-4d4a-a2c8-0e5d6ae5def4 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:25.415990 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-eade5131-232c-4d4a-a2c8-0e5d6ae5def4 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:25.416429 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-eade5131-232c-4d4a-a2c8-0e5d6ae5def4 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:25.550226 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-eade5131-232c-4d4a-a2c8-0e5d6ae5def4 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:25.558189 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-eade5131-232c-4d4a-a2c8-0e5d6ae5def4 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1260 microversion: 2.1 time: 0.155209 Jun 03 10:02:25.558754 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 278/559] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:25 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:26.572725 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell0:SELECT=2 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:26.576891 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-a6339b6a-302f-4a8f-87f6-b1d9054c3886 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:26.582211 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-a6339b6a-302f-4a8f-87f6-b1d9054c3886 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:26.584001 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a6339b6a-302f-4a8f-87f6-b1d9054c3886 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:26.584462 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a6339b6a-302f-4a8f-87f6-b1d9054c3886 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:26.585232 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a6339b6a-302f-4a8f-87f6-b1d9054c3886 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:26.585703 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a6339b6a-302f-4a8f-87f6-b1d9054c3886 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:26.716395 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-a6339b6a-302f-4a8f-87f6-b1d9054c3886 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:26.723798 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-a6339b6a-302f-4a8f-87f6-b1d9054c3886 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1260 microversion: 2.1 time: 0.152520 Jun 03 10:02:26.724368 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 282/560] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:26 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:27.740972 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-7cb371cb-9931-47cc-af09-9d81114da890 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:27.741585 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-7cb371cb-9931-47cc-af09-9d81114da890 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:27.744483 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell0:SELECT=8 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:27.745161 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:27.750031 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7cb371cb-9931-47cc-af09-9d81114da890 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:27.750483 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7cb371cb-9931-47cc-af09-9d81114da890 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:27.751242 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7cb371cb-9931-47cc-af09-9d81114da890 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:27.751719 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7cb371cb-9931-47cc-af09-9d81114da890 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:27.882681 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-7cb371cb-9931-47cc-af09-9d81114da890 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:27.890938 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-7cb371cb-9931-47cc-af09-9d81114da890 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1260 microversion: 2.1 time: 0.154358 Jun 03 10:02:27.891501 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 279/561] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:27 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:02:28.807718 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-e8bb38e8-99da-4fe4-b299-9245f1794d76 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:28.808249 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-e8bb38e8-99da-4fe4-b299-9245f1794d76 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:28.815319 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e8bb38e8-99da-4fe4-b299-9245f1794d76 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:28.815816 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e8bb38e8-99da-4fe4-b299-9245f1794d76 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:28.825858 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e8bb38e8-99da-4fe4-b299-9245f1794d76 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:28.825858 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e8bb38e8-99da-4fe4-b299-9245f1794d76 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:28.845772 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-e8bb38e8-99da-4fe4-b299-9245f1794d76 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46/os-volume_attachments/30bc81b5-b17a-423c-beaa-1e02a5021841" status: 200 len: 194 microversion: 2.20 time: 0.042719 Jun 03 10:02:28.846392 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 283/562] 10.222.0.42 () {60 vars in 1453 bytes} [Fri Jun 3 10:02:28 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46/os-volume_attachments/30bc81b5-b17a-423c-beaa-1e02a5021841 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 10:02:28.907710 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-76c969b8-12d7-4750-8011-bf237aba3ec3 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:28.908208 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-763719b4-e3cf-412d-a100-5163c4005697 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:28.908326 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-76c969b8-12d7-4750-8011-bf237aba3ec3 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:28.908576 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-763719b4-e3cf-412d-a100-5163c4005697 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:28.914760 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-763719b4-e3cf-412d-a100-5163c4005697 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:28.915203 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-763719b4-e3cf-412d-a100-5163c4005697 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:28.915315 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-76c969b8-12d7-4750-8011-bf237aba3ec3 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:28.916172 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-76c969b8-12d7-4750-8011-bf237aba3ec3 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:28.916492 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-763719b4-e3cf-412d-a100-5163c4005697 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:28.916920 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-763719b4-e3cf-412d-a100-5163c4005697 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:28.917023 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-76c969b8-12d7-4750-8011-bf237aba3ec3 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:28.917493 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-76c969b8-12d7-4750-8011-bf237aba3ec3 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:28.995494 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:29.000847 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.objects.instance [None req-763719b4-e3cf-412d-a100-5163c4005697 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lazy-loading 'services' on Instance uuid 6517823d-711a-4e24-9cdf-27812d522a46 {{(pid=125066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:02:29.113101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-76c969b8-12d7-4750-8011-bf237aba3ec3 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:29.121476 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-76c969b8-12d7-4750-8011-bf237aba3ec3 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1260 microversion: 2.1 time: 0.217656 Jun 03 10:02:29.122098 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 280/563] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:28 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1260 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:29.245296 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-763719b4-e3cf-412d-a100-5163c4005697 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46/os-volume_attachments/30bc81b5-b17a-423c-beaa-1e02a5021841" status: 202 len: 0 microversion: 2.20 time: 0.340859 Jun 03 10:02:29.246370 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 284/564] 10.222.0.42 () {60 vars in 1456 bytes} [Fri Jun 3 10:02:28 2022] DELETE /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46/os-volume_attachments/30bc81b5-b17a-423c-beaa-1e02a5021841 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 03 10:02:29.254432 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-32df265b-f471-4e6d-b0fb-ef0634f0030e tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:29.255604 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-32df265b-f471-4e6d-b0fb-ef0634f0030e tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:29.262359 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-32df265b-f471-4e6d-b0fb-ef0634f0030e tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:29.262808 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-32df265b-f471-4e6d-b0fb-ef0634f0030e tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:29.263578 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-32df265b-f471-4e6d-b0fb-ef0634f0030e tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:29.264009 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-32df265b-f471-4e6d-b0fb-ef0634f0030e tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:29.298664 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-32df265b-f471-4e6d-b0fb-ef0634f0030e tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048344 Jun 03 10:02:29.299225 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 281/565] 10.222.0.42 () {60 vars in 1342 bytes} [Fri Jun 3 10:02:29 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 10:02:29.874294 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-87fa43ba-29eb-4f01-a516-04aeef49d1de tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-14155291", "imageRef": "0d2dd03b-4531-46f3-88da-0380e97b1bd4", "flavorRef": "452", "networks": [{"uuid": "67c024cb-fdda-41b3-a0ad-2b9c4d36578f"}]}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:29.925482 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.network.neutron [None req-87fa43ba-29eb-4f01-a516-04aeef49d1de tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] validate_networks() for [('67c024cb-fdda-41b3-a0ad-2b9c4d36578f', None, None, None, None, None)] {{(pid=125066) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 10:02:30.144410 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-3e4b7a90-ab7f-40bd-a7be-d9e6029404cc tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:30.145014 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-3e4b7a90-ab7f-40bd-a7be-d9e6029404cc tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:30.151488 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3e4b7a90-ab7f-40bd-a7be-d9e6029404cc tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:30.151933 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3e4b7a90-ab7f-40bd-a7be-d9e6029404cc tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:30.152692 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3e4b7a90-ab7f-40bd-a7be-d9e6029404cc tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:30.153126 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3e4b7a90-ab7f-40bd-a7be-d9e6029404cc tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:30.340730 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-87fa43ba-29eb-4f01-a516-04aeef49d1de tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Flavor limits 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 10:02:30.341239 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-87fa43ba-29eb-4f01-a516-04aeef49d1de tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Image limits 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 10:02:30.341827 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-87fa43ba-29eb-4f01-a516-04aeef49d1de tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Flavor pref 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 10:02:30.342281 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-87fa43ba-29eb-4f01-a516-04aeef49d1de tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Image pref 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 10:02:30.342689 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-87fa43ba-29eb-4f01-a516-04aeef49d1de tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 10:02:30.351465 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-87fa43ba-29eb-4f01-a516-04aeef49d1de tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:30.359452 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-87fa43ba-29eb-4f01-a516-04aeef49d1de tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:30.359452 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-87fa43ba-29eb-4f01-a516-04aeef49d1de tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:30.359452 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-87fa43ba-29eb-4f01-a516-04aeef49d1de tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:30.359870 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-3e4b7a90-ab7f-40bd-a7be-d9e6029404cc tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:30.365401 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-3e4b7a90-ab7f-40bd-a7be-d9e6029404cc tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1260 microversion: 2.1 time: 0.224815 Jun 03 10:02:30.365994 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 282/566] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:30 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1260 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:02:30.370996 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-87fa43ba-29eb-4f01-a516-04aeef49d1de tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Getting quotas for project 6a0f8d737269433bb6ce1baf51b8157b. Resources: {'ram', 'instances', 'cores'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:02:30.371344 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-03d6be7a-c0aa-4a1b-aeaf-ccd81427d2c5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:30.372380 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-03d6be7a-c0aa-4a1b-aeaf-ccd81427d2c5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:30.375199 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-87fa43ba-29eb-4f01-a516-04aeef49d1de tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Getting quotas for user 82621df465a640b28eb955733ceda02f and project 6a0f8d737269433bb6ce1baf51b8157b. Resources: {'ram', 'instances', 'cores'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:02:30.378640 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-03d6be7a-c0aa-4a1b-aeaf-ccd81427d2c5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:30.379097 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-03d6be7a-c0aa-4a1b-aeaf-ccd81427d2c5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:30.379864 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-03d6be7a-c0aa-4a1b-aeaf-ccd81427d2c5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:30.380563 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-03d6be7a-c0aa-4a1b-aeaf-ccd81427d2c5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:30.387359 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-87fa43ba-29eb-4f01-a516-04aeef49d1de tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Going to run 1 instances... {{(pid=125066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 10:02:30.389779 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-87fa43ba-29eb-4f01-a516-04aeef49d1de tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: f21c35e4-2a21-41c4-91bb-e28a3a75fb35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2dd03b-4531-46f3-88da-0380e97b1bd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 10:02:30.411224 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-03d6be7a-c0aa-4a1b-aeaf-ccd81427d2c5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044161 Jun 03 10:02:30.411753 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 283/567] 10.222.0.42 () {60 vars in 1342 bytes} [Fri Jun 3 10:02:30 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 10:02:30.572978 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-87fa43ba-29eb-4f01-a516-04aeef49d1de tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.704319 Jun 03 10:02:30.573622 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 285/568] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 3 10:02:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 10:02:30.583689 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-54730314-a054-4574-873c-7ca68e750a73 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:30.584289 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-54730314-a054-4574-873c-7ca68e750a73 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: f21c35e4-2a21-41c4-91bb-e28a3a75fb35] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:30.638895 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-54730314-a054-4574-873c-7ca68e750a73 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:30.645781 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-54730314-a054-4574-873c-7ca68e750a73 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35" status: 200 len: 1217 microversion: 2.1 time: 0.066025 Jun 03 10:02:30.646377 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 284/569] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:30 2022] GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35 => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:31.384166 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-821fc74b-93c8-4a0d-80f5-6dcb536750d8 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:31.386254 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-821fc74b-93c8-4a0d-80f5-6dcb536750d8 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:31.393308 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-821fc74b-93c8-4a0d-80f5-6dcb536750d8 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:31.396462 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-821fc74b-93c8-4a0d-80f5-6dcb536750d8 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:31.396462 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-821fc74b-93c8-4a0d-80f5-6dcb536750d8 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:31.396462 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-821fc74b-93c8-4a0d-80f5-6dcb536750d8 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:31.422640 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-51fdfda1-0526-48ed-8245-cc03500b1d90 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:31.423587 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-51fdfda1-0526-48ed-8245-cc03500b1d90 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:31.433192 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-51fdfda1-0526-48ed-8245-cc03500b1d90 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:31.433644 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-51fdfda1-0526-48ed-8245-cc03500b1d90 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:31.434439 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-51fdfda1-0526-48ed-8245-cc03500b1d90 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:31.434877 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-51fdfda1-0526-48ed-8245-cc03500b1d90 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:31.463936 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-51fdfda1-0526-48ed-8245-cc03500b1d90 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045345 Jun 03 10:02:31.464583 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 285/570] 10.222.0.42 () {60 vars in 1342 bytes} [Fri Jun 3 10:02:31 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:02:31.528275 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-3b9bbf4d-cf7c-42ef-86c6-c26293713953 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:31.528772 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-3b9bbf4d-cf7c-42ef-86c6-c26293713953 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:31.534376 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-821fc74b-93c8-4a0d-80f5-6dcb536750d8 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:31.536046 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3b9bbf4d-cf7c-42ef-86c6-c26293713953 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:31.536500 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3b9bbf4d-cf7c-42ef-86c6-c26293713953 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:31.537269 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3b9bbf4d-cf7c-42ef-86c6-c26293713953 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:31.537716 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3b9bbf4d-cf7c-42ef-86c6-c26293713953 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:31.542029 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-821fc74b-93c8-4a0d-80f5-6dcb536750d8 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1260 microversion: 2.1 time: 0.162585 Jun 03 10:02:31.547747 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 286/571] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:31 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:31.562955 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-3b9bbf4d-cf7c-42ef-86c6-c26293713953 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Going to try to terminate instance {{(pid=125065) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:02:31.662799 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-84a9b930-21a2-4388-a050-e145234ed17f tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:31.663411 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-84a9b930-21a2-4388-a050-e145234ed17f tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: f21c35e4-2a21-41c4-91bb-e28a3a75fb35] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:31.669361 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-84a9b930-21a2-4388-a050-e145234ed17f tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:31.669916 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-84a9b930-21a2-4388-a050-e145234ed17f tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:31.670680 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-84a9b930-21a2-4388-a050-e145234ed17f tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:31.671119 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-84a9b930-21a2-4388-a050-e145234ed17f tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:31.734252 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-84a9b930-21a2-4388-a050-e145234ed17f tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:31.741869 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-84a9b930-21a2-4388-a050-e145234ed17f tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35" status: 200 len: 1221 microversion: 2.1 time: 0.082855 Jun 03 10:02:31.742463 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 287/572] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:31 2022] GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35 => generated 1221 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:02:31.800411 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-3b9bbf4d-cf7c-42ef-86c6-c26293713953 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 204 len: 0 microversion: 2.20 time: 0.275787 Jun 03 10:02:31.800992 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 286/573] 10.222.0.42 () {60 vars in 1279 bytes} [Fri Jun 3 10:02:31 2022] DELETE /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 03 10:02:31.809933 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-102ba4f2-13a3-45a5-aee6-47148e169227 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:31.810540 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-102ba4f2-13a3-45a5-aee6-47148e169227 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:31.816656 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-102ba4f2-13a3-45a5-aee6-47148e169227 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:31.817100 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-102ba4f2-13a3-45a5-aee6-47148e169227 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:31.817855 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-102ba4f2-13a3-45a5-aee6-47148e169227 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:31.818311 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-102ba4f2-13a3-45a5-aee6-47148e169227 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:31.949546 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-102ba4f2-13a3-45a5-aee6-47148e169227 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:31.957905 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-102ba4f2-13a3-45a5-aee6-47148e169227 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:31.959401 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-102ba4f2-13a3-45a5-aee6-47148e169227 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:31.960543 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-102ba4f2-13a3-45a5-aee6-47148e169227 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1724 microversion: 2.20 time: 0.155249 Jun 03 10:02:31.961091 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 288/574] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:02:31 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:02:32.563011 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-ce359ea3-4efa-4db4-8c99-7cfdb4a3c647 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:32.563759 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-ce359ea3-4efa-4db4-8c99-7cfdb4a3c647 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:32.569806 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ce359ea3-4efa-4db4-8c99-7cfdb4a3c647 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:32.570284 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ce359ea3-4efa-4db4-8c99-7cfdb4a3c647 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:32.571045 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ce359ea3-4efa-4db4-8c99-7cfdb4a3c647 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:32.571512 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ce359ea3-4efa-4db4-8c99-7cfdb4a3c647 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:32.576072 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:32.700470 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-ce359ea3-4efa-4db4-8c99-7cfdb4a3c647 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:32.707861 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-ce359ea3-4efa-4db4-8c99-7cfdb4a3c647 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1260 microversion: 2.1 time: 0.149038 Jun 03 10:02:32.708422 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 287/575] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:32 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:32.759355 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-05995367-f688-4ae2-9c1a-08360d652a7d tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:32.760225 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-05995367-f688-4ae2-9c1a-08360d652a7d tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: f21c35e4-2a21-41c4-91bb-e28a3a75fb35] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:32.767594 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-05995367-f688-4ae2-9c1a-08360d652a7d tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:32.768048 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-05995367-f688-4ae2-9c1a-08360d652a7d tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:32.768807 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-05995367-f688-4ae2-9c1a-08360d652a7d tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:32.769259 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-05995367-f688-4ae2-9c1a-08360d652a7d tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:32.831874 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-05995367-f688-4ae2-9c1a-08360d652a7d tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:32.840051 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-05995367-f688-4ae2-9c1a-08360d652a7d tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35" status: 200 len: 1213 microversion: 2.1 time: 0.084507 Jun 03 10:02:32.840826 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 289/576] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:32 2022] GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:32.978816 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-92e23678-6284-4167-9903-e40a8180d257 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:32.980036 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-92e23678-6284-4167-9903-e40a8180d257 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:32.986146 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-92e23678-6284-4167-9903-e40a8180d257 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:32.986603 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-92e23678-6284-4167-9903-e40a8180d257 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:32.987361 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-92e23678-6284-4167-9903-e40a8180d257 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:32.987799 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-92e23678-6284-4167-9903-e40a8180d257 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:33.120276 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-92e23678-6284-4167-9903-e40a8180d257 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:33.128535 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-92e23678-6284-4167-9903-e40a8180d257 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:33.130120 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-92e23678-6284-4167-9903-e40a8180d257 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:33.131469 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-92e23678-6284-4167-9903-e40a8180d257 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1724 microversion: 2.20 time: 0.156522 Jun 03 10:02:33.132082 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 288/577] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:02:32 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:02:33.725130 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-a5c4f664-1d4b-4717-8bc8-18d436ee1c97 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:33.725261 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-a5c4f664-1d4b-4717-8bc8-18d436ee1c97 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:33.731367 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a5c4f664-1d4b-4717-8bc8-18d436ee1c97 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:33.731814 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a5c4f664-1d4b-4717-8bc8-18d436ee1c97 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:33.732566 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a5c4f664-1d4b-4717-8bc8-18d436ee1c97 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:33.732998 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a5c4f664-1d4b-4717-8bc8-18d436ee1c97 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:33.857099 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-030f4f3d-e6fd-4931-b218-971f52f7a851 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:33.857897 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-030f4f3d-e6fd-4931-b218-971f52f7a851 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: f21c35e4-2a21-41c4-91bb-e28a3a75fb35] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:33.865020 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-030f4f3d-e6fd-4931-b218-971f52f7a851 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:33.865182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-a5c4f664-1d4b-4717-8bc8-18d436ee1c97 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:33.865580 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-030f4f3d-e6fd-4931-b218-971f52f7a851 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:33.866281 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-030f4f3d-e6fd-4931-b218-971f52f7a851 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:33.866786 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-030f4f3d-e6fd-4931-b218-971f52f7a851 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:33.874773 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-a5c4f664-1d4b-4717-8bc8-18d436ee1c97 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1260 microversion: 2.1 time: 0.153854 Jun 03 10:02:33.875547 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 290/578] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:33 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:33.931484 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-030f4f3d-e6fd-4931-b218-971f52f7a851 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:33.939010 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-030f4f3d-e6fd-4931-b218-971f52f7a851 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35" status: 200 len: 1269 microversion: 2.1 time: 0.086316 Jun 03 10:02:33.939576 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 289/579] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:33 2022] GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35 => generated 1269 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:02:34.150026 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-ca72512e-1c92-43b4-b1f9-4643600dda12 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:34.150641 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-ca72512e-1c92-43b4-b1f9-4643600dda12 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:34.156695 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ca72512e-1c92-43b4-b1f9-4643600dda12 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:34.157151 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ca72512e-1c92-43b4-b1f9-4643600dda12 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:34.157952 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ca72512e-1c92-43b4-b1f9-4643600dda12 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:34.158419 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ca72512e-1c92-43b4-b1f9-4643600dda12 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:34.284265 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-ca72512e-1c92-43b4-b1f9-4643600dda12 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:34.292782 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-ca72512e-1c92-43b4-b1f9-4643600dda12 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:34.294306 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-ca72512e-1c92-43b4-b1f9-4643600dda12 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:34.295461 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-ca72512e-1c92-43b4-b1f9-4643600dda12 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1724 microversion: 2.20 time: 0.149502 Jun 03 10:02:34.296122 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 291/580] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:02:34 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:02:34.891860 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-6f621587-0ed7-4e6b-95ff-17503d291d46 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:34.893150 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-6f621587-0ed7-4e6b-95ff-17503d291d46 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:34.899998 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6f621587-0ed7-4e6b-95ff-17503d291d46 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:34.905591 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6f621587-0ed7-4e6b-95ff-17503d291d46 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:34.905591 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6f621587-0ed7-4e6b-95ff-17503d291d46 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:34.905591 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6f621587-0ed7-4e6b-95ff-17503d291d46 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:34.965403 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-af1976b2-918a-48d1-aa08-9d873cbd3634 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:34.966126 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-af1976b2-918a-48d1-aa08-9d873cbd3634 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: f21c35e4-2a21-41c4-91bb-e28a3a75fb35] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:34.987695 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-af1976b2-918a-48d1-aa08-9d873cbd3634 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:34.991459 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-af1976b2-918a-48d1-aa08-9d873cbd3634 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:34.991459 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-af1976b2-918a-48d1-aa08-9d873cbd3634 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:34.991459 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-af1976b2-918a-48d1-aa08-9d873cbd3634 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:35.110106 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-af1976b2-918a-48d1-aa08-9d873cbd3634 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:35.117572 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-af1976b2-918a-48d1-aa08-9d873cbd3634 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35" status: 200 len: 1275 microversion: 2.1 time: 0.164805 Jun 03 10:02:35.118183 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 292/581] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:34 2022] GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35 => generated 1275 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:35.122597 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-42bcc79e-79dd-4f22-90df-ea58cd886633 req-6057ecc4-77d6-4231-87ae-f91ad77157a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5afad0ea-b328-43cf-8ed2-f500796569b0", "name": "network-vif-plugged", "status": "completed", "tag": "895de58e-9396-45ee-adb3-b1ce59bb1799"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:35.130610 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-42bcc79e-79dd-4f22-90df-ea58cd886633 req-6057ecc4-77d6-4231-87ae-f91ad77157a3 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:35.131056 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-42bcc79e-79dd-4f22-90df-ea58cd886633 req-6057ecc4-77d6-4231-87ae-f91ad77157a3 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:35.143441 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-42bcc79e-79dd-4f22-90df-ea58cd886633 req-6057ecc4-77d6-4231-87ae-f91ad77157a3 service nova] Creating event network-vif-plugged:895de58e-9396-45ee-adb3-b1ce59bb1799 for instance 5afad0ea-b328-43cf-8ed2-f500796569b0 on hv-cinder-84456 Jun 03 10:02:35.148332 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-42bcc79e-79dd-4f22-90df-ea58cd886633 req-6057ecc4-77d6-4231-87ae-f91ad77157a3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029039 Jun 03 10:02:35.148934 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 293/582] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:02:35.177553 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-6f621587-0ed7-4e6b-95ff-17503d291d46 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:35.196117 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-6f621587-0ed7-4e6b-95ff-17503d291d46 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1260 microversion: 2.1 time: 0.308029 Jun 03 10:02:35.197747 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 290/583] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:34 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1260 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:35.314959 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-ecee0806-eb54-4b92-824f-10d8412df4bb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:35.315688 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-ecee0806-eb54-4b92-824f-10d8412df4bb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:35.322162 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ecee0806-eb54-4b92-824f-10d8412df4bb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:35.329717 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ecee0806-eb54-4b92-824f-10d8412df4bb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:35.329717 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ecee0806-eb54-4b92-824f-10d8412df4bb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:35.329717 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ecee0806-eb54-4b92-824f-10d8412df4bb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:35.417115 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-ecee0806-eb54-4b92-824f-10d8412df4bb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:35.426048 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-ecee0806-eb54-4b92-824f-10d8412df4bb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:35.427805 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-ecee0806-eb54-4b92-824f-10d8412df4bb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:35.429297 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-ecee0806-eb54-4b92-824f-10d8412df4bb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1657 microversion: 2.20 time: 0.118678 Jun 03 10:02:35.430012 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 294/584] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:02:35 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1657 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:02:36.032340 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-36d964f2-fd75-46f1-b210-4315403487f2 req-71aba235-bd2d-4561-a4b6-e30dc9b5a417 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6517823d-711a-4e24-9cdf-27812d522a46", "name": "network-vif-deleted", "tag": "a93886de-f812-40e6-81ba-b35e06454a66"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:36.041100 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-36d964f2-fd75-46f1-b210-4315403487f2 req-71aba235-bd2d-4561-a4b6-e30dc9b5a417 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:36.041671 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-36d964f2-fd75-46f1-b210-4315403487f2 req-71aba235-bd2d-4561-a4b6-e30dc9b5a417 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:36.054789 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-36d964f2-fd75-46f1-b210-4315403487f2 req-71aba235-bd2d-4561-a4b6-e30dc9b5a417 service nova] Creating event network-vif-deleted:a93886de-f812-40e6-81ba-b35e06454a66 for instance 6517823d-711a-4e24-9cdf-27812d522a46 on hv-cinder-84456 Jun 03 10:02:36.060746 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-36d964f2-fd75-46f1-b210-4315403487f2 req-71aba235-bd2d-4561-a4b6-e30dc9b5a417 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032317 Jun 03 10:02:36.061350 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 291/585] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:02:36.135134 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-d2c71f7c-cc4e-4cad-90e2-0212f33e1700 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:36.136489 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-d2c71f7c-cc4e-4cad-90e2-0212f33e1700 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: f21c35e4-2a21-41c4-91bb-e28a3a75fb35] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:36.154666 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d2c71f7c-cc4e-4cad-90e2-0212f33e1700 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:36.154666 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d2c71f7c-cc4e-4cad-90e2-0212f33e1700 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:36.154666 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d2c71f7c-cc4e-4cad-90e2-0212f33e1700 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:36.154997 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d2c71f7c-cc4e-4cad-90e2-0212f33e1700 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:36.215981 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-8d502485-6414-4287-a64b-264fdfc8ca22 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:36.216540 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-8d502485-6414-4287-a64b-264fdfc8ca22 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:36.223438 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8d502485-6414-4287-a64b-264fdfc8ca22 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:36.224083 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8d502485-6414-4287-a64b-264fdfc8ca22 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:36.225027 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8d502485-6414-4287-a64b-264fdfc8ca22 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:36.225621 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8d502485-6414-4287-a64b-264fdfc8ca22 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:36.393789 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-d2c71f7c-cc4e-4cad-90e2-0212f33e1700 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:36.409013 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-d2c71f7c-cc4e-4cad-90e2-0212f33e1700 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35" status: 200 len: 1317 microversion: 2.1 time: 0.277852 Jun 03 10:02:36.409660 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 295/586] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:36 2022] GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35 => generated 1317 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:36.448741 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-84acf1d9-2153-4668-ba49-732c104c7823 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:36.449735 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-84acf1d9-2153-4668-ba49-732c104c7823 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:36.457951 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-84acf1d9-2153-4668-ba49-732c104c7823 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:36.458411 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-84acf1d9-2153-4668-ba49-732c104c7823 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:36.462033 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-84acf1d9-2153-4668-ba49-732c104c7823 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:36.463271 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-84acf1d9-2153-4668-ba49-732c104c7823 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:36.485379 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-8d502485-6414-4287-a64b-264fdfc8ca22 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:36.497036 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-8d502485-6414-4287-a64b-264fdfc8ca22 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1260 microversion: 2.1 time: 0.286508 Jun 03 10:02:36.497909 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 292/587] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:36 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1260 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:36.571458 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-84acf1d9-2153-4668-ba49-732c104c7823 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:36.587536 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-84acf1d9-2153-4668-ba49-732c104c7823 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:36.590105 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-84acf1d9-2153-4668-ba49-732c104c7823 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:36.591648 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-84acf1d9-2153-4668-ba49-732c104c7823 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1366 microversion: 2.20 time: 0.146671 Jun 03 10:02:36.592799 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 296/588] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:02:36 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:02:37.426657 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-1e636877-f135-4731-90ab-b03cd70dcf75 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:37.427371 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-1e636877-f135-4731-90ab-b03cd70dcf75 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: f21c35e4-2a21-41c4-91bb-e28a3a75fb35] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:37.435530 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1e636877-f135-4731-90ab-b03cd70dcf75 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:37.437328 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1e636877-f135-4731-90ab-b03cd70dcf75 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:37.438832 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1e636877-f135-4731-90ab-b03cd70dcf75 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:37.439461 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1e636877-f135-4731-90ab-b03cd70dcf75 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:37.515137 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-1442829d-6a63-469a-8e45-f740ce067cce tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:37.515749 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-1442829d-6a63-469a-8e45-f740ce067cce tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:37.522817 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1442829d-6a63-469a-8e45-f740ce067cce tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:37.523271 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1442829d-6a63-469a-8e45-f740ce067cce tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:37.524093 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1442829d-6a63-469a-8e45-f740ce067cce tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:37.524504 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1442829d-6a63-469a-8e45-f740ce067cce tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:37.608349 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-1e636877-f135-4731-90ab-b03cd70dcf75 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:37.616222 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-1e636877-f135-4731-90ab-b03cd70dcf75 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35" status: 200 len: 1317 microversion: 2.1 time: 0.193584 Jun 03 10:02:37.617361 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 293/589] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:37 2022] GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35 => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:37.621988 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-d55980e1-3cd5-4082-921d-c0b5850f6cb7 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:37.622929 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-d55980e1-3cd5-4082-921d-c0b5850f6cb7 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:37.633350 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d55980e1-3cd5-4082-921d-c0b5850f6cb7 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:37.638340 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d55980e1-3cd5-4082-921d-c0b5850f6cb7 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:37.638340 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d55980e1-3cd5-4082-921d-c0b5850f6cb7 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:37.638340 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d55980e1-3cd5-4082-921d-c0b5850f6cb7 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:37.669217 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d55980e1-3cd5-4082-921d-c0b5850f6cb7 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:37.669729 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d55980e1-3cd5-4082-921d-c0b5850f6cb7 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:37.670229 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.objects.instance [None req-d55980e1-3cd5-4082-921d-c0b5850f6cb7 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lazy-loading 'fault' on Instance uuid 6517823d-711a-4e24-9cdf-27812d522a46 {{(pid=125065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:02:37.680606 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-1442829d-6a63-469a-8e45-f740ce067cce tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:37.688197 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-1442829d-6a63-469a-8e45-f740ce067cce tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1260 microversion: 2.1 time: 0.177497 Jun 03 10:02:37.688773 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 297/590] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:37 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:37.718396 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-d55980e1-3cd5-4082-921d-c0b5850f6cb7 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:37.726931 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-d55980e1-3cd5-4082-921d-c0b5850f6cb7 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:37.728422 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-d55980e1-3cd5-4082-921d-c0b5850f6cb7 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:37.730177 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-d55980e1-3cd5-4082-921d-c0b5850f6cb7 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 200 len: 1371 microversion: 2.20 time: 0.111764 Jun 03 10:02:37.730933 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 294/591] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:02:37 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 1371 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:02:38.076579 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-3b63ce57-57f1-4ea4-8de1-6ca85b66c1a4 req-79418da9-2584-4509-a1a1-70c82b4cb487 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f21c35e4-2a21-41c4-91bb-e28a3a75fb35", "tag": "f21d0899-8240-4786-a3d8-13e5ab18a6a5"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:38.085204 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-3b63ce57-57f1-4ea4-8de1-6ca85b66c1a4 req-79418da9-2584-4509-a1a1-70c82b4cb487 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:38.085653 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-3b63ce57-57f1-4ea4-8de1-6ca85b66c1a4 req-79418da9-2584-4509-a1a1-70c82b4cb487 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:38.098165 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-3b63ce57-57f1-4ea4-8de1-6ca85b66c1a4 req-79418da9-2584-4509-a1a1-70c82b4cb487 service nova] Creating event network-changed:f21d0899-8240-4786-a3d8-13e5ab18a6a5 for instance f21c35e4-2a21-41c4-91bb-e28a3a75fb35 on hv-cinder-84456 Jun 03 10:02:38.106571 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-3b63ce57-57f1-4ea4-8de1-6ca85b66c1a4 req-79418da9-2584-4509-a1a1-70c82b4cb487 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030684 Jun 03 10:02:38.110488 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 298/592] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:02:38.632550 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-fd51ce4c-cace-4a4b-b0e7-3faabf81e5d5 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:38.633159 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-fd51ce4c-cace-4a4b-b0e7-3faabf81e5d5 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: f21c35e4-2a21-41c4-91bb-e28a3a75fb35] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:38.640691 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-fd51ce4c-cace-4a4b-b0e7-3faabf81e5d5 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:38.641088 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-fd51ce4c-cace-4a4b-b0e7-3faabf81e5d5 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:38.641841 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-fd51ce4c-cace-4a4b-b0e7-3faabf81e5d5 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:38.642307 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-fd51ce4c-cace-4a4b-b0e7-3faabf81e5d5 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:38.707097 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-b7f03fcb-bd68-4a45-a9f1-1bb02e3aa6f7 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:38.707818 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-b7f03fcb-bd68-4a45-a9f1-1bb02e3aa6f7 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:38.719861 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b7f03fcb-bd68-4a45-a9f1-1bb02e3aa6f7 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:38.720509 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b7f03fcb-bd68-4a45-a9f1-1bb02e3aa6f7 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:38.721522 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b7f03fcb-bd68-4a45-a9f1-1bb02e3aa6f7 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:38.722387 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b7f03fcb-bd68-4a45-a9f1-1bb02e3aa6f7 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:38.808867 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-fd51ce4c-cace-4a4b-b0e7-3faabf81e5d5 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:38.816597 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-fd51ce4c-cace-4a4b-b0e7-3faabf81e5d5 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35" status: 200 len: 1317 microversion: 2.1 time: 0.187800 Jun 03 10:02:38.826751 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 295/593] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:38 2022] GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35 => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:38.826751 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-5756c615-71f3-4e30-9000-80ebdfe23a29 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:38.826751 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-5756c615-71f3-4e30-9000-80ebdfe23a29 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:38.834942 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5756c615-71f3-4e30-9000-80ebdfe23a29 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:38.835237 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5756c615-71f3-4e30-9000-80ebdfe23a29 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:38.836194 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5756c615-71f3-4e30-9000-80ebdfe23a29 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:38.836774 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5756c615-71f3-4e30-9000-80ebdfe23a29 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:38.853179 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.wsgi [None req-5756c615-71f3-4e30-9000-80ebdfe23a29 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] HTTP exception thrown: Instance 6517823d-711a-4e24-9cdf-27812d522a46 could not be found. Jun 03 10:02:38.855154 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-5756c615-71f3-4e30-9000-80ebdfe23a29 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Request method failure captured: Jun 03 10:02:38.855154 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: request: GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 HTTP/1.1 Jun 03 10:02:38.855154 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept: application/json Jun 03 10:02:38.855154 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept-Encoding: identity Jun 03 10:02:38.855154 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Connection: close Jun 03 10:02:38.855154 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Length: 0 Jun 03 10:02:38.855154 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Type: application/json Jun 03 10:02:38.855154 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Host: 10.222.0.42 Jun 03 10:02:38.855154 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Openstack-System-Scope: None Jun 03 10:02:38.855154 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: User-Agent: python-urllib3/1.26.9 Jun 03 10:02:38.855154 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Auth-Token: gAAAAABimdtDyYEJ77YsGiOuv1BqHCLCT-FQnnFwcIg64gFxPxCelCnyjijn2-o4KWcqHOUg5cSOqXP30EE03kvtu0gESwuB2N-uvNGBuvh6Wre5iHjsBgAKH6a0r9Z7M5bYmRLTYTbv7Jg4IfzYVhE4gtvjy0zjIWDPmQjSXHde_X_80fn1dB0 Jun 03 10:02:38.855154 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Id: None Jun 03 10:02:38.855154 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Name: None Jun 03 10:02:38.855154 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Identity-Status: Confirmed Jun 03 10:02:38.855154 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Is-Admin-Project: True Jun 03 10:02:38.855154 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 10:02:38.855154 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Id: default Jun 03 10:02:38.855154 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Name: Default Jun 03 10:02:38.855154 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Id: 57756244f164417dad785bb5927d05b6 Jun 03 10:02:38.855154 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1243409567 Jun 03 10:02:38.855154 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Role: member,reader Jun 03 10:02:38.855154 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Roles: member,reader Jun 03 10:02:38.856805 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/57756244f164417dad785bb5927d05b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/57756244f164417dad785bb5927d05b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_57756244f164417dad785bb5927d05b6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/57756244f164417dad785bb5927d05b6"}]}] Jun 03 10:02:38.856805 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1243409567 Jun 03 10:02:38.856805 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Id: 57756244f164417dad785bb5927d05b6 Jun 03 10:02:38.856805 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1243409567 Jun 03 10:02:38.856805 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User: tempest-AttachVolumeShelveTestJSON-1243409567-project Jun 03 10:02:38.856805 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Id: default Jun 03 10:02:38.856805 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Name: Default Jun 03 10:02:38.856805 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Id: 5a304d58eff84a87953dc7af6a0afe87 Jun 03 10:02:38.856805 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1243409567-project Jun 03 10:02:38.856805 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: method: > Jun 03 10:02:38.856805 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: exception: Instance 6517823d-711a-4e24-9cdf-27812d522a46 could not be found. Jun 03 10:02:38.856805 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: action_args: {'id': '6517823d-711a-4e24-9cdf-27812d522a46'} Jun 03 10:02:38.857689 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:02:38.857689 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:02:38.857689 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:02:38.857689 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:02:38.857689 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:02:38.857689 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:02:38.857689 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:02:38.857689 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:02:38.857689 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:02:38.857689 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:02:38.857689 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6517823d-711a-4e24-9cdf-27812d522a46 could not be found. Jun 03 10:02:38.857689 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:02:38.857689 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:02:38.857689 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:02:38.857689 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:02:38.857689 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:02:38.857689 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:02:38.857689 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:02:38.857689 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:02:38.857689 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:02:38.859278 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:02:38.859278 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:02:38.859278 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:02:38.859278 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:02:38.859278 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:02:38.859278 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:02:38.859278 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:02:38.859278 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6517823d-711a-4e24-9cdf-27812d522a46 could not be found. Jun 03 10:02:38.859278 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:02:38.859278 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:02:38.859278 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:02:38.859278 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:02:38.859278 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:02:38.859278 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:02:38.859278 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:02:38.859278 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:02:38.859278 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6517823d-711a-4e24-9cdf-27812d522a46 could not be found. Jun 03 10:02:38.859278 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:02:38.860671 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-5756c615-71f3-4e30-9000-80ebdfe23a29 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Returning 404 to user: Instance 6517823d-711a-4e24-9cdf-27812d522a46 could not be found. {{(pid=125065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:02:38.860671 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-5756c615-71f3-4e30-9000-80ebdfe23a29 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 404 len: 111 microversion: 2.20 time: 0.037914 Jun 03 10:02:38.860671 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 296/594] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:02:38 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 10:02:38.865393 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-b80f7f67-0759-48b7-9dd1-13fa97d192f0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '.version_select at 0x7f8d236f6dc0>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:38.899957 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-b7f03fcb-bd68-4a45-a9f1-1bb02e3aa6f7 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:38.907524 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-b7f03fcb-bd68-4a45-a9f1-1bb02e3aa6f7 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1443 microversion: 2.1 time: 0.205958 Jun 03 10:02:38.908091 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 299/595] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:38 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1443 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:38.922963 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-9a344194-2e5a-4304-a8fd-3a9c07208575 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:38.923564 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-9a344194-2e5a-4304-a8fd-3a9c07208575 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:38.929254 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9a344194-2e5a-4304-a8fd-3a9c07208575 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:38.933383 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9a344194-2e5a-4304-a8fd-3a9c07208575 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:38.933383 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9a344194-2e5a-4304-a8fd-3a9c07208575 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:38.933383 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9a344194-2e5a-4304-a8fd-3a9c07208575 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:38.954679 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-b80f7f67-0759-48b7-9dd1-13fa97d192f0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1494498149" status: 204 len: 0 microversion: 2.20 time: 0.092878 Jun 03 10:02:38.955329 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 297/596] 10.222.0.42 () {60 vars in 1261 bytes} [Fri Jun 3 10:02:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1494498149 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 03 10:02:39.071103 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-9a344194-2e5a-4304-a8fd-3a9c07208575 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:39.080359 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-9a344194-2e5a-4304-a8fd-3a9c07208575 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1443 microversion: 2.1 time: 0.160907 Jun 03 10:02:39.082758 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 300/597] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:38 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1443 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:02:39.834398 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-5a0f491f-9ab5-404c-ae69-88e0f6dcfb36 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:39.835027 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-5a0f491f-9ab5-404c-ae69-88e0f6dcfb36 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: f21c35e4-2a21-41c4-91bb-e28a3a75fb35] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:39.842345 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5a0f491f-9ab5-404c-ae69-88e0f6dcfb36 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:39.842791 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5a0f491f-9ab5-404c-ae69-88e0f6dcfb36 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:39.843549 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5a0f491f-9ab5-404c-ae69-88e0f6dcfb36 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:39.843976 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5a0f491f-9ab5-404c-ae69-88e0f6dcfb36 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:40.156560 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-5a0f491f-9ab5-404c-ae69-88e0f6dcfb36 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:40.171355 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-5a0f491f-9ab5-404c-ae69-88e0f6dcfb36 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35" status: 200 len: 1317 microversion: 2.1 time: 0.334601 Jun 03 10:02:40.171355 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 298/598] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:39 2022] GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35 => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:40.201194 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-62d2e77f-2176-4947-80d3-baa9cbc4c8a6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Action: 'create', calling method: .version_select at 0x7f8d23e56700>, body: {"keypair": {"name": "tempest-keypair-1158113069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFojj6VWNNqRYV4VUfiwVk1WkViwQUtHjaFpIUFDFg6eZJOUIuAD9fd2hEU65IUOuYaN5awG4341JwkPGozs+j1u6fRVACHyOxhNMl6DSmLvzX1EUBf4H9ZtlMYRr0a1w=="}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:40.216025 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-62d2e77f-2176-4947-80d3-baa9cbc4c8a6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Getting quotas for project 57756244f164417dad785bb5927d05b6. Resources: {'key_pairs'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:02:40.219951 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-62d2e77f-2176-4947-80d3-baa9cbc4c8a6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Getting quotas for user 5a304d58eff84a87953dc7af6a0afe87 and project 57756244f164417dad785bb5927d05b6. Resources: {'key_pairs'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:02:40.360998 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell0:SELECT=2 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:40.368033 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-62d2e77f-2176-4947-80d3-baa9cbc4c8a6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.170859 Jun 03 10:02:40.373385 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 301/599] 10.222.0.42 () {62 vars in 1199 bytes} [Fri Jun 3 10:02:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 172 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 03 10:02:41.187459 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-3021bf26-f2db-46aa-b8e0-c3367ad87edd tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:41.192788 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-3021bf26-f2db-46aa-b8e0-c3367ad87edd tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: f21c35e4-2a21-41c4-91bb-e28a3a75fb35] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:41.194245 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell0:SELECT=2 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:41.196248 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3021bf26-f2db-46aa-b8e0-c3367ad87edd tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:41.196692 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3021bf26-f2db-46aa-b8e0-c3367ad87edd tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:41.197457 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3021bf26-f2db-46aa-b8e0-c3367ad87edd tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:41.197979 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3021bf26-f2db-46aa-b8e0-c3367ad87edd tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:41.395443 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-3021bf26-f2db-46aa-b8e0-c3367ad87edd tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:41.404653 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-3021bf26-f2db-46aa-b8e0-c3367ad87edd tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35" status: 200 len: 1317 microversion: 2.1 time: 0.221044 Jun 03 10:02:41.406557 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 299/600] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:41 2022] GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35 => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:42.059866 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-679f024c-0da6-46d6-9165-809bd0e4f8d6 req-bf1f4e19-5228-4b37-89e4-dec9df03861f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5afad0ea-b328-43cf-8ed2-f500796569b0", "tag": "895de58e-9396-45ee-adb3-b1ce59bb1799"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:42.070808 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-679f024c-0da6-46d6-9165-809bd0e4f8d6 req-bf1f4e19-5228-4b37-89e4-dec9df03861f service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:42.071259 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-679f024c-0da6-46d6-9165-809bd0e4f8d6 req-bf1f4e19-5228-4b37-89e4-dec9df03861f service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:42.083148 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-679f024c-0da6-46d6-9165-809bd0e4f8d6 req-bf1f4e19-5228-4b37-89e4-dec9df03861f service nova] Creating event network-changed:895de58e-9396-45ee-adb3-b1ce59bb1799 for instance 5afad0ea-b328-43cf-8ed2-f500796569b0 on hv-cinder-84456 Jun 03 10:02:42.088644 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-679f024c-0da6-46d6-9165-809bd0e4f8d6 req-bf1f4e19-5228-4b37-89e4-dec9df03861f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033572 Jun 03 10:02:42.089593 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 302/601] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:02:42.426519 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-39de849d-15a9-4b5a-9da2-3f23eebcacac tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:42.428711 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-39de849d-15a9-4b5a-9da2-3f23eebcacac tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: f21c35e4-2a21-41c4-91bb-e28a3a75fb35] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:42.440220 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-39de849d-15a9-4b5a-9da2-3f23eebcacac tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:42.443707 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-39de849d-15a9-4b5a-9da2-3f23eebcacac tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:42.443707 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-39de849d-15a9-4b5a-9da2-3f23eebcacac tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:42.443707 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-39de849d-15a9-4b5a-9da2-3f23eebcacac tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:42.684644 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-39de849d-15a9-4b5a-9da2-3f23eebcacac tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:42.697924 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-39de849d-15a9-4b5a-9da2-3f23eebcacac tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35" status: 200 len: 1317 microversion: 2.1 time: 0.278318 Jun 03 10:02:42.708807 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 300/602] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:42 2022] GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35 => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:42.975931 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-e444d08e-9165-4520-b7e0-b1d0cdf07968 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1005469659", "imageRef": "0d2dd03b-4531-46f3-88da-0380e97b1bd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1dd31c87-764e-47aa-825b-25f1a52d1c3d"}], "security_groups": [{"name": "tempest-securitygroup--1629283229"}], "key_name": "tempest-keypair-1158113069", "user_data": "}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:43.083689 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.network.neutron [None req-e444d08e-9165-4520-b7e0-b1d0cdf07968 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] validate_networks() for [('1dd31c87-764e-47aa-825b-25f1a52d1c3d', None, None, None, None, None)] {{(pid=125066) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 10:02:43.107979 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-215bf4f5-1e3d-4e2a-a0a6-a0665a16ff68 req-6583615d-1c7b-4881-b6bc-2fbf8cade624 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f21c35e4-2a21-41c4-91bb-e28a3a75fb35", "name": "network-vif-plugged", "status": "completed", "tag": "f21d0899-8240-4786-a3d8-13e5ab18a6a5"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:43.116937 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-215bf4f5-1e3d-4e2a-a0a6-a0665a16ff68 req-6583615d-1c7b-4881-b6bc-2fbf8cade624 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:43.117377 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-215bf4f5-1e3d-4e2a-a0a6-a0665a16ff68 req-6583615d-1c7b-4881-b6bc-2fbf8cade624 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:43.128897 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-215bf4f5-1e3d-4e2a-a0a6-a0665a16ff68 req-6583615d-1c7b-4881-b6bc-2fbf8cade624 service nova] Creating event network-vif-plugged:f21d0899-8240-4786-a3d8-13e5ab18a6a5 for instance f21c35e4-2a21-41c4-91bb-e28a3a75fb35 on hv-cinder-84456 Jun 03 10:02:43.133748 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-215bf4f5-1e3d-4e2a-a0a6-a0665a16ff68 req-6583615d-1c7b-4881-b6bc-2fbf8cade624 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030044 Jun 03 10:02:43.134379 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 301/603] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:02:43.471898 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-e444d08e-9165-4520-b7e0-b1d0cdf07968 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Flavor limits 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 10:02:43.472327 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-e444d08e-9165-4520-b7e0-b1d0cdf07968 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Image limits 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 10:02:43.472805 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-e444d08e-9165-4520-b7e0-b1d0cdf07968 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Flavor pref 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 10:02:43.473477 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-e444d08e-9165-4520-b7e0-b1d0cdf07968 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Image pref 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 10:02:43.473933 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-e444d08e-9165-4520-b7e0-b1d0cdf07968 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 10:02:43.483678 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e444d08e-9165-4520-b7e0-b1d0cdf07968 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:43.484125 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e444d08e-9165-4520-b7e0-b1d0cdf07968 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:43.484958 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e444d08e-9165-4520-b7e0-b1d0cdf07968 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:43.487204 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e444d08e-9165-4520-b7e0-b1d0cdf07968 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:43.502609 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-e444d08e-9165-4520-b7e0-b1d0cdf07968 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Getting quotas for project 57756244f164417dad785bb5927d05b6. Resources: {'ram', 'instances', 'cores'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:02:43.506667 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-e444d08e-9165-4520-b7e0-b1d0cdf07968 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Getting quotas for user 5a304d58eff84a87953dc7af6a0afe87 and project 57756244f164417dad785bb5927d05b6. Resources: {'ram', 'instances', 'cores'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:02:43.518656 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-e444d08e-9165-4520-b7e0-b1d0cdf07968 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Going to run 1 instances... {{(pid=125066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 10:02:43.521097 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-e444d08e-9165-4520-b7e0-b1d0cdf07968 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2dd03b-4531-46f3-88da-0380e97b1bd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 10:02:43.636299 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-e444d08e-9165-4520-b7e0-b1d0cdf07968 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.664455 Jun 03 10:02:43.637090 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 303/604] 10.222.0.42 () {62 vars in 1187 bytes} [Fri Jun 3 10:02:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 03 10:02:43.647984 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-80338ba2-9521-414d-b848-9c542c503db0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:43.648672 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-80338ba2-9521-414d-b848-9c542c503db0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:43.702808 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-80338ba2-9521-414d-b848-9c542c503db0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:43.710206 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-80338ba2-9521-414d-b848-9c542c503db0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:43.711859 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-80338ba2-9521-414d-b848-9c542c503db0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:43.713067 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-80338ba2-9521-414d-b848-9c542c503db0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1282 microversion: 2.20 time: 0.069765 Jun 03 10:02:43.713725 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 302/605] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:02:43 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1282 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:02:43.724968 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-d31bdf3a-0d07-4ff4-a0ef-0db54402cc5a tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:43.725517 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-d31bdf3a-0d07-4ff4-a0ef-0db54402cc5a tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: f21c35e4-2a21-41c4-91bb-e28a3a75fb35] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:43.732752 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d31bdf3a-0d07-4ff4-a0ef-0db54402cc5a tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:43.733213 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d31bdf3a-0d07-4ff4-a0ef-0db54402cc5a tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:43.734010 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d31bdf3a-0d07-4ff4-a0ef-0db54402cc5a tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:43.734462 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d31bdf3a-0d07-4ff4-a0ef-0db54402cc5a tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:43.866603 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-d31bdf3a-0d07-4ff4-a0ef-0db54402cc5a tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:43.874793 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-d31bdf3a-0d07-4ff4-a0ef-0db54402cc5a tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35" status: 200 len: 1317 microversion: 2.1 time: 0.153764 Jun 03 10:02:43.875364 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 304/606] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:43 2022] GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:44.731082 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-704ffc96-590d-4b2c-a5c8-402df6355425 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:44.731716 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-704ffc96-590d-4b2c-a5c8-402df6355425 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:44.740310 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-704ffc96-590d-4b2c-a5c8-402df6355425 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:44.740763 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-704ffc96-590d-4b2c-a5c8-402df6355425 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:44.741519 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-704ffc96-590d-4b2c-a5c8-402df6355425 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:44.741976 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-704ffc96-590d-4b2c-a5c8-402df6355425 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:44.802625 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-704ffc96-590d-4b2c-a5c8-402df6355425 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:44.810465 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-704ffc96-590d-4b2c-a5c8-402df6355425 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:44.811964 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-704ffc96-590d-4b2c-a5c8-402df6355425 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:44.813059 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-704ffc96-590d-4b2c-a5c8-402df6355425 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1286 microversion: 2.20 time: 0.086053 Jun 03 10:02:44.813610 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 303/607] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:02:44 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:02:44.892364 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-113afd0f-4c30-4d1e-947e-440c7a66bc39 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:44.893006 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-113afd0f-4c30-4d1e-947e-440c7a66bc39 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: f21c35e4-2a21-41c4-91bb-e28a3a75fb35] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:44.899679 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-113afd0f-4c30-4d1e-947e-440c7a66bc39 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:44.900132 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-113afd0f-4c30-4d1e-947e-440c7a66bc39 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:44.900910 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-113afd0f-4c30-4d1e-947e-440c7a66bc39 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:44.901349 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-113afd0f-4c30-4d1e-947e-440c7a66bc39 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:44.904109 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:45.031931 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-113afd0f-4c30-4d1e-947e-440c7a66bc39 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:45.039311 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-113afd0f-4c30-4d1e-947e-440c7a66bc39 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35" status: 200 len: 1317 microversion: 2.1 time: 0.150888 Jun 03 10:02:45.039901 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 305/608] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:44 2022] GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:45.831441 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-86f60ea9-2296-40c1-910d-ed7bbc01fb22 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:45.832081 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-86f60ea9-2296-40c1-910d-ed7bbc01fb22 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:45.838567 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-86f60ea9-2296-40c1-910d-ed7bbc01fb22 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:45.839021 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-86f60ea9-2296-40c1-910d-ed7bbc01fb22 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:45.840277 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-86f60ea9-2296-40c1-910d-ed7bbc01fb22 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:45.840708 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-86f60ea9-2296-40c1-910d-ed7bbc01fb22 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:45.904333 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-86f60ea9-2296-40c1-910d-ed7bbc01fb22 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:45.912154 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-86f60ea9-2296-40c1-910d-ed7bbc01fb22 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:45.913648 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-86f60ea9-2296-40c1-910d-ed7bbc01fb22 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:45.914772 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-86f60ea9-2296-40c1-910d-ed7bbc01fb22 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1334 microversion: 2.20 time: 0.087258 Jun 03 10:02:45.915330 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 304/609] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:02:45 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1334 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:02:46.055691 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-57a4484e-62ee-4053-bfb1-b355462c3c03 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:46.059797 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-57a4484e-62ee-4053-bfb1-b355462c3c03 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: f21c35e4-2a21-41c4-91bb-e28a3a75fb35] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:46.062916 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-57a4484e-62ee-4053-bfb1-b355462c3c03 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:46.063370 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-57a4484e-62ee-4053-bfb1-b355462c3c03 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:46.064156 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-57a4484e-62ee-4053-bfb1-b355462c3c03 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:46.064592 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-57a4484e-62ee-4053-bfb1-b355462c3c03 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:46.269865 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-57a4484e-62ee-4053-bfb1-b355462c3c03 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:46.279142 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-57a4484e-62ee-4053-bfb1-b355462c3c03 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35" status: 200 len: 1506 microversion: 2.1 time: 0.227335 Jun 03 10:02:46.279714 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 306/610] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:46 2022] GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35 => generated 1506 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:02:46.295802 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-7a4603b0-adc6-4fb7-82c4-f73f3db616c4 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52a53fe4-3253-4d3e-9e19-84ad837f84e2", "device": "/dev/sdb"}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:46.297618 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-7a4603b0-adc6-4fb7-82c4-f73f3db616c4 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: f21c35e4-2a21-41c4-91bb-e28a3a75fb35] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:46.303749 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7a4603b0-adc6-4fb7-82c4-f73f3db616c4 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:46.304210 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7a4603b0-adc6-4fb7-82c4-f73f3db616c4 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:46.305519 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7a4603b0-adc6-4fb7-82c4-f73f3db616c4 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:46.305641 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7a4603b0-adc6-4fb7-82c4-f73f3db616c4 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:46.933196 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-db5394de-8b37-483b-b995-9200dc9743ba tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:46.934038 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-db5394de-8b37-483b-b995-9200dc9743ba tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:46.940272 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-db5394de-8b37-483b-b995-9200dc9743ba tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:46.940805 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-db5394de-8b37-483b-b995-9200dc9743ba tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:46.941575 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-db5394de-8b37-483b-b995-9200dc9743ba tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:46.942066 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-db5394de-8b37-483b-b995-9200dc9743ba tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:47.100997 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-db5394de-8b37-483b-b995-9200dc9743ba tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:47.101756 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-7a4603b0-adc6-4fb7-82c4-f73f3db616c4 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "POST /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.809661 Jun 03 10:02:47.102473 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 305/611] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jun 3 10:02:46 2022] POST /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35/os-volume_attachments => generated 194 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:02:47.114894 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-db5394de-8b37-483b-b995-9200dc9743ba tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:47.116833 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-db5394de-8b37-483b-b995-9200dc9743ba tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:47.123531 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-db5394de-8b37-483b-b995-9200dc9743ba tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1408 microversion: 2.20 time: 0.189142 Jun 03 10:02:47.123531 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 307/612] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:02:46 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1408 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:02:47.946733 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-01976099-298b-4c5c-ac3a-46bd1ba3e20a req-800d8c71-fbcb-4526-944f-09b659ffc8c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc", "tag": "3b6360f1-9329-469d-913b-3b05fed8cd88"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:47.956410 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-01976099-298b-4c5c-ac3a-46bd1ba3e20a req-800d8c71-fbcb-4526-944f-09b659ffc8c9 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:47.956881 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-01976099-298b-4c5c-ac3a-46bd1ba3e20a req-800d8c71-fbcb-4526-944f-09b659ffc8c9 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:47.961259 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:47.970131 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-01976099-298b-4c5c-ac3a-46bd1ba3e20a req-800d8c71-fbcb-4526-944f-09b659ffc8c9 service nova] Creating event network-changed:3b6360f1-9329-469d-913b-3b05fed8cd88 for instance a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc on hv-cinder-84456 Jun 03 10:02:47.974946 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-01976099-298b-4c5c-ac3a-46bd1ba3e20a req-800d8c71-fbcb-4526-944f-09b659ffc8c9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033472 Jun 03 10:02:47.975549 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 306/613] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:02:48.140825 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-b344de48-b02b-424a-93c4-8d5ca25a69f1 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:48.144509 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-b344de48-b02b-424a-93c4-8d5ca25a69f1 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:48.148081 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b344de48-b02b-424a-93c4-8d5ca25a69f1 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:48.148536 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b344de48-b02b-424a-93c4-8d5ca25a69f1 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:48.149308 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b344de48-b02b-424a-93c4-8d5ca25a69f1 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:48.149747 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b344de48-b02b-424a-93c4-8d5ca25a69f1 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:48.360453 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-b344de48-b02b-424a-93c4-8d5ca25a69f1 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:48.368829 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-b344de48-b02b-424a-93c4-8d5ca25a69f1 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:48.370400 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-b344de48-b02b-424a-93c4-8d5ca25a69f1 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:48.372409 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-b344de48-b02b-424a-93c4-8d5ca25a69f1 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1408 microversion: 2.20 time: 0.236112 Jun 03 10:02:48.372976 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 308/614] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:02:48 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1408 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:02:49.391778 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-c46fe3c3-6f37-4840-b77d-8efe27d26f1d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:49.392418 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-c46fe3c3-6f37-4840-b77d-8efe27d26f1d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:49.398968 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c46fe3c3-6f37-4840-b77d-8efe27d26f1d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:49.399434 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c46fe3c3-6f37-4840-b77d-8efe27d26f1d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:49.400185 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c46fe3c3-6f37-4840-b77d-8efe27d26f1d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:49.400629 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c46fe3c3-6f37-4840-b77d-8efe27d26f1d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:49.530220 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-c46fe3c3-6f37-4840-b77d-8efe27d26f1d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:49.538051 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-c46fe3c3-6f37-4840-b77d-8efe27d26f1d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:49.539597 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-c46fe3c3-6f37-4840-b77d-8efe27d26f1d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:49.540700 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-c46fe3c3-6f37-4840-b77d-8efe27d26f1d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1408 microversion: 2.20 time: 0.154287 Jun 03 10:02:49.541254 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 307/615] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:02:49 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:02:50.558870 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-3303c3de-60d7-4233-aeed-5771c205102c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:50.559485 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-3303c3de-60d7-4233-aeed-5771c205102c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:50.566351 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3303c3de-60d7-4233-aeed-5771c205102c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:50.566832 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3303c3de-60d7-4233-aeed-5771c205102c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:50.567593 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3303c3de-60d7-4233-aeed-5771c205102c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:50.568031 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3303c3de-60d7-4233-aeed-5771c205102c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:50.698110 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-3303c3de-60d7-4233-aeed-5771c205102c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:50.706612 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-3303c3de-60d7-4233-aeed-5771c205102c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:50.708117 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-3303c3de-60d7-4233-aeed-5771c205102c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:50.709211 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-3303c3de-60d7-4233-aeed-5771c205102c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1408 microversion: 2.20 time: 0.154275 Jun 03 10:02:50.709770 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 309/616] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:02:50 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:02:51.727360 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-279df780-f4b0-403a-948c-437c4f8aa792 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:51.727960 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-279df780-f4b0-403a-948c-437c4f8aa792 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:51.735208 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-279df780-f4b0-403a-948c-437c4f8aa792 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:51.735684 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-279df780-f4b0-403a-948c-437c4f8aa792 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:51.736429 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-279df780-f4b0-403a-948c-437c4f8aa792 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:51.736856 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-279df780-f4b0-403a-948c-437c4f8aa792 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:51.861372 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-279df780-f4b0-403a-948c-437c4f8aa792 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:51.869133 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-279df780-f4b0-403a-948c-437c4f8aa792 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:51.870649 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-279df780-f4b0-403a-948c-437c4f8aa792 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:51.871727 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-279df780-f4b0-403a-948c-437c4f8aa792 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1408 microversion: 2.20 time: 0.148286 Jun 03 10:02:51.872272 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 308/617] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:02:51 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:02:52.090988 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-28475f14-9cf8-4396-9acb-ed8c1f89f1f4 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:52.091987 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-28475f14-9cf8-4396-9acb-ed8c1f89f1f4 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:52.094304 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:52.099064 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-28475f14-9cf8-4396-9acb-ed8c1f89f1f4 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:52.099515 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-28475f14-9cf8-4396-9acb-ed8c1f89f1f4 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:52.100277 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-28475f14-9cf8-4396-9acb-ed8c1f89f1f4 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:52.100717 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-28475f14-9cf8-4396-9acb-ed8c1f89f1f4 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:52.129975 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-28475f14-9cf8-4396-9acb-ed8c1f89f1f4 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042928 Jun 03 10:02:52.130525 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 310/618] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 3 10:02:52 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 10:02:52.186943 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-d72341fd-d013-4aa7-b804-5f3b282c7d1e tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:52.187434 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-d72341fd-d013-4aa7-b804-5f3b282c7d1e tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:52.193347 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d72341fd-d013-4aa7-b804-5f3b282c7d1e tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:52.193795 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d72341fd-d013-4aa7-b804-5f3b282c7d1e tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:52.194577 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d72341fd-d013-4aa7-b804-5f3b282c7d1e tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:52.195009 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d72341fd-d013-4aa7-b804-5f3b282c7d1e tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:52.221487 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-d72341fd-d013-4aa7-b804-5f3b282c7d1e tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Going to try to terminate instance {{(pid=125065) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:02:52.531372 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-d72341fd-d013-4aa7-b804-5f3b282c7d1e tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "DELETE /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 204 len: 0 microversion: 2.1 time: 0.348468 Jun 03 10:02:52.531952 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 309/619] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 3 10:02:52 2022] DELETE /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:02:52.550449 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-8448c3e8-d34b-452e-81d3-46b7c8d5ae4c tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:52.551083 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-8448c3e8-d34b-452e-81d3-46b7c8d5ae4c tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:52.557520 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8448c3e8-d34b-452e-81d3-46b7c8d5ae4c tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:52.572710 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8448c3e8-d34b-452e-81d3-46b7c8d5ae4c tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:52.572710 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8448c3e8-d34b-452e-81d3-46b7c8d5ae4c tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:52.572710 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8448c3e8-d34b-452e-81d3-46b7c8d5ae4c tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:52.689260 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-8448c3e8-d34b-452e-81d3-46b7c8d5ae4c tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:52.697697 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-8448c3e8-d34b-452e-81d3-46b7c8d5ae4c tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1676 microversion: 2.1 time: 0.151160 Jun 03 10:02:52.698290 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 311/620] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:52 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:52.890467 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-ef93c71e-e156-48e5-90fb-b779b4551dee tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:52.891085 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-ef93c71e-e156-48e5-90fb-b779b4551dee tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:52.897475 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ef93c71e-e156-48e5-90fb-b779b4551dee tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:52.897949 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ef93c71e-e156-48e5-90fb-b779b4551dee tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:52.898700 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ef93c71e-e156-48e5-90fb-b779b4551dee tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:52.899125 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ef93c71e-e156-48e5-90fb-b779b4551dee tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:53.033443 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-ef93c71e-e156-48e5-90fb-b779b4551dee tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:53.041720 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-ef93c71e-e156-48e5-90fb-b779b4551dee tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:53.043261 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-ef93c71e-e156-48e5-90fb-b779b4551dee tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:53.044963 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-ef93c71e-e156-48e5-90fb-b779b4551dee tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1408 microversion: 2.20 time: 0.158886 Jun 03 10:02:53.045531 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 310/621] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:02:52 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:02:53.716001 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-dbea7bfb-1271-49d1-b6e2-d248f67f9a25 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:53.716533 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-dbea7bfb-1271-49d1-b6e2-d248f67f9a25 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:53.718845 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell0:SELECT=2 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:53.719657 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell0:SELECT=16 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:53.724596 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-dbea7bfb-1271-49d1-b6e2-d248f67f9a25 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:53.725047 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-dbea7bfb-1271-49d1-b6e2-d248f67f9a25 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:53.725812 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-dbea7bfb-1271-49d1-b6e2-d248f67f9a25 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:53.726279 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-dbea7bfb-1271-49d1-b6e2-d248f67f9a25 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:53.852537 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-dbea7bfb-1271-49d1-b6e2-d248f67f9a25 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:53.860999 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-dbea7bfb-1271-49d1-b6e2-d248f67f9a25 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1676 microversion: 2.1 time: 0.149450 Jun 03 10:02:53.861608 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 312/622] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:53 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:54.061813 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-f87fd981-f3ad-46a8-801d-ee4d3fc30d25 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:54.062443 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-f87fd981-f3ad-46a8-801d-ee4d3fc30d25 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:54.064428 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell0:SELECT=2 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:54.071334 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f87fd981-f3ad-46a8-801d-ee4d3fc30d25 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:54.071835 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f87fd981-f3ad-46a8-801d-ee4d3fc30d25 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:54.072659 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f87fd981-f3ad-46a8-801d-ee4d3fc30d25 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:54.073093 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f87fd981-f3ad-46a8-801d-ee4d3fc30d25 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:54.209389 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f87fd981-f3ad-46a8-801d-ee4d3fc30d25 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:54.211794 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f87fd981-f3ad-46a8-801d-ee4d3fc30d25 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:54.213309 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f87fd981-f3ad-46a8-801d-ee4d3fc30d25 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:54.214447 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-f87fd981-f3ad-46a8-801d-ee4d3fc30d25 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1408 microversion: 2.20 time: 0.156732 Jun 03 10:02:54.215056 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 311/623] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:02:54 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:02:54.878601 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-822a18f4-6d15-4ae3-8e3f-d26d00dd85a7 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:54.879246 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-822a18f4-6d15-4ae3-8e3f-d26d00dd85a7 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:54.885911 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-822a18f4-6d15-4ae3-8e3f-d26d00dd85a7 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:54.886381 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-822a18f4-6d15-4ae3-8e3f-d26d00dd85a7 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:54.887145 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-822a18f4-6d15-4ae3-8e3f-d26d00dd85a7 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:54.887583 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-822a18f4-6d15-4ae3-8e3f-d26d00dd85a7 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:55.015236 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-822a18f4-6d15-4ae3-8e3f-d26d00dd85a7 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:55.022811 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-822a18f4-6d15-4ae3-8e3f-d26d00dd85a7 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1676 microversion: 2.1 time: 0.148022 Jun 03 10:02:55.023413 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 313/624] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:54 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:55.121913 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-4d82fdd8-c20b-40b4-b373-8f3d5e4be036 req-cdfff514-7904-4b82-a802-a812f12ccf45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc", "name": "network-vif-plugged", "status": "completed", "tag": "3b6360f1-9329-469d-913b-3b05fed8cd88"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:55.130586 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-4d82fdd8-c20b-40b4-b373-8f3d5e4be036 req-cdfff514-7904-4b82-a802-a812f12ccf45 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:55.131030 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-4d82fdd8-c20b-40b4-b373-8f3d5e4be036 req-cdfff514-7904-4b82-a802-a812f12ccf45 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:55.142603 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-4d82fdd8-c20b-40b4-b373-8f3d5e4be036 req-cdfff514-7904-4b82-a802-a812f12ccf45 service nova] Creating event network-vif-plugged:3b6360f1-9329-469d-913b-3b05fed8cd88 for instance a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc on hv-cinder-84456 Jun 03 10:02:55.147333 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-4d82fdd8-c20b-40b4-b373-8f3d5e4be036 req-cdfff514-7904-4b82-a802-a812f12ccf45 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029106 Jun 03 10:02:55.147983 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 312/625] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:02:55.232821 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-0562e211-59a5-4e5e-a043-84eb9d573d2c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:55.235336 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-0562e211-59a5-4e5e-a043-84eb9d573d2c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:55.240965 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0562e211-59a5-4e5e-a043-84eb9d573d2c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:55.241485 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0562e211-59a5-4e5e-a043-84eb9d573d2c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:55.242416 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0562e211-59a5-4e5e-a043-84eb9d573d2c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:55.243027 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0562e211-59a5-4e5e-a043-84eb9d573d2c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:55.416212 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-0562e211-59a5-4e5e-a043-84eb9d573d2c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:55.424335 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-0562e211-59a5-4e5e-a043-84eb9d573d2c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:55.425842 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-0562e211-59a5-4e5e-a043-84eb9d573d2c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:55.426999 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-0562e211-59a5-4e5e-a043-84eb9d573d2c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1408 microversion: 2.20 time: 0.198331 Jun 03 10:02:55.427558 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 314/626] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:02:55 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:02:56.040884 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-c1b49db0-0a9e-435d-b53f-6b32be6072a3 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:56.041578 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-c1b49db0-0a9e-435d-b53f-6b32be6072a3 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:56.048521 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c1b49db0-0a9e-435d-b53f-6b32be6072a3 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:56.048969 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c1b49db0-0a9e-435d-b53f-6b32be6072a3 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:56.049732 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c1b49db0-0a9e-435d-b53f-6b32be6072a3 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:56.050214 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c1b49db0-0a9e-435d-b53f-6b32be6072a3 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:56.272451 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-c1b49db0-0a9e-435d-b53f-6b32be6072a3 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:56.280593 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-c1b49db0-0a9e-435d-b53f-6b32be6072a3 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1676 microversion: 2.1 time: 0.243785 Jun 03 10:02:56.281160 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 313/627] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:56 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1676 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:02:56.444610 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-85d00d59-ce52-429b-a649-5657089fe352 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:56.464401 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-85d00d59-ce52-429b-a649-5657089fe352 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:56.464401 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-85d00d59-ce52-429b-a649-5657089fe352 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:56.464401 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-85d00d59-ce52-429b-a649-5657089fe352 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:56.464401 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-85d00d59-ce52-429b-a649-5657089fe352 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:56.466684 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-85d00d59-ce52-429b-a649-5657089fe352 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:56.655526 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-85d00d59-ce52-429b-a649-5657089fe352 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:56.665905 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-85d00d59-ce52-429b-a649-5657089fe352 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:56.667917 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-85d00d59-ce52-429b-a649-5657089fe352 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:56.670036 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-85d00d59-ce52-429b-a649-5657089fe352 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1408 microversion: 2.20 time: 0.228632 Jun 03 10:02:56.671281 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 315/628] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:02:56 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1408 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:02:56.820155 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-4d240cf5-7fcc-4fdd-a924-31dfdedc1816 req-e81055d2-9a2c-424b-816e-e038020e60af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d7bf3d-d6e9-4a78-bf74-77b44928b1d3", "name": "network-vif-deleted", "tag": "5e8649fd-c65a-45e0-87b5-6023ff2fceaf"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:56.831144 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-4d240cf5-7fcc-4fdd-a924-31dfdedc1816 req-e81055d2-9a2c-424b-816e-e038020e60af service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:56.832536 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-4d240cf5-7fcc-4fdd-a924-31dfdedc1816 req-e81055d2-9a2c-424b-816e-e038020e60af service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:56.846488 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-4d240cf5-7fcc-4fdd-a924-31dfdedc1816 req-e81055d2-9a2c-424b-816e-e038020e60af service nova] Creating event network-vif-deleted:5e8649fd-c65a-45e0-87b5-6023ff2fceaf for instance 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 on hv-cinder-84456 Jun 03 10:02:56.851924 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-4d240cf5-7fcc-4fdd-a924-31dfdedc1816 req-e81055d2-9a2c-424b-816e-e038020e60af service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035967 Jun 03 10:02:56.852927 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 314/629] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:02:57.297987 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-068cc8fb-2131-457c-8f35-c500d9a3ac55 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:57.298631 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-068cc8fb-2131-457c-8f35-c500d9a3ac55 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:57.304668 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-068cc8fb-2131-457c-8f35-c500d9a3ac55 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:57.305122 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-068cc8fb-2131-457c-8f35-c500d9a3ac55 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:57.305931 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-068cc8fb-2131-457c-8f35-c500d9a3ac55 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:57.306400 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-068cc8fb-2131-457c-8f35-c500d9a3ac55 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:57.337416 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-068cc8fb-2131-457c-8f35-c500d9a3ac55 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:57.337867 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-068cc8fb-2131-457c-8f35-c500d9a3ac55 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:57.338343 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.objects.instance [None req-068cc8fb-2131-457c-8f35-c500d9a3ac55 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lazy-loading 'fault' on Instance uuid 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 {{(pid=125066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:02:57.381110 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-068cc8fb-2131-457c-8f35-c500d9a3ac55 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:57.389555 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-068cc8fb-2131-457c-8f35-c500d9a3ac55 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1328 microversion: 2.1 time: 0.095954 Jun 03 10:02:57.390217 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 316/630] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:57 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1328 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:57.689575 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-6516305b-51dd-49f4-814e-d9c5164d3225 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:57.690410 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-6516305b-51dd-49f4-814e-d9c5164d3225 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:57.696888 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6516305b-51dd-49f4-814e-d9c5164d3225 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:57.697340 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6516305b-51dd-49f4-814e-d9c5164d3225 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:57.698195 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6516305b-51dd-49f4-814e-d9c5164d3225 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:57.698564 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6516305b-51dd-49f4-814e-d9c5164d3225 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:57.833152 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-6516305b-51dd-49f4-814e-d9c5164d3225 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:57.841147 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-6516305b-51dd-49f4-814e-d9c5164d3225 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:57.842675 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-6516305b-51dd-49f4-814e-d9c5164d3225 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:57.843779 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-6516305b-51dd-49f4-814e-d9c5164d3225 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1408 microversion: 2.20 time: 0.159482 Jun 03 10:02:57.844333 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 315/631] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:02:57 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:02:58.407220 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-77534a79-df01-4461-a304-2ebe44a5b7e5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:58.407764 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-77534a79-df01-4461-a304-2ebe44a5b7e5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:58.414712 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-77534a79-df01-4461-a304-2ebe44a5b7e5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:58.415157 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-77534a79-df01-4461-a304-2ebe44a5b7e5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:58.415902 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-77534a79-df01-4461-a304-2ebe44a5b7e5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:58.416330 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-77534a79-df01-4461-a304-2ebe44a5b7e5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:58.446469 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-77534a79-df01-4461-a304-2ebe44a5b7e5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:58.446911 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-77534a79-df01-4461-a304-2ebe44a5b7e5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:58.447348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.objects.instance [None req-77534a79-df01-4461-a304-2ebe44a5b7e5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lazy-loading 'fault' on Instance uuid 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 {{(pid=125066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:02:58.490707 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-77534a79-df01-4461-a304-2ebe44a5b7e5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:58.498191 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-77534a79-df01-4461-a304-2ebe44a5b7e5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1328 microversion: 2.1 time: 0.095423 Jun 03 10:02:58.498768 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 317/632] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:58 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1328 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:58.860606 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-ea0afadf-23f2-49e4-9217-87afb0398664 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:58.861213 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-ea0afadf-23f2-49e4-9217-87afb0398664 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:58.863659 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:58.868398 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ea0afadf-23f2-49e4-9217-87afb0398664 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:58.868841 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ea0afadf-23f2-49e4-9217-87afb0398664 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:58.869676 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ea0afadf-23f2-49e4-9217-87afb0398664 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:58.870060 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ea0afadf-23f2-49e4-9217-87afb0398664 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:58.999324 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-ea0afadf-23f2-49e4-9217-87afb0398664 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:59.007155 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-ea0afadf-23f2-49e4-9217-87afb0398664 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:59.008652 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-ea0afadf-23f2-49e4-9217-87afb0398664 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:59.010059 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-ea0afadf-23f2-49e4-9217-87afb0398664 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1408 microversion: 2.20 time: 0.153065 Jun 03 10:02:59.010618 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 316/633] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:02:58 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:02:59.514737 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-d1905ebe-95a4-4323-aea7-ead080a408ac tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:59.515345 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-d1905ebe-95a4-4323-aea7-ead080a408ac tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:59.521928 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d1905ebe-95a4-4323-aea7-ead080a408ac tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:59.522379 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d1905ebe-95a4-4323-aea7-ead080a408ac tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:59.523125 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d1905ebe-95a4-4323-aea7-ead080a408ac tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:59.523605 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d1905ebe-95a4-4323-aea7-ead080a408ac tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:59.554632 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d1905ebe-95a4-4323-aea7-ead080a408ac tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:59.555079 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d1905ebe-95a4-4323-aea7-ead080a408ac tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:59.555523 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.objects.instance [None req-d1905ebe-95a4-4323-aea7-ead080a408ac tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lazy-loading 'fault' on Instance uuid 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 {{(pid=125066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:02:59.597355 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-d1905ebe-95a4-4323-aea7-ead080a408ac tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:59.605820 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-d1905ebe-95a4-4323-aea7-ead080a408ac tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1328 microversion: 2.1 time: 0.095458 Jun 03 10:02:59.606558 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 318/634] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:59 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1328 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:00.027289 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-0baa8a6d-7917-43a8-8976-e735367c5642 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:00.027851 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-0baa8a6d-7917-43a8-8976-e735367c5642 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:00.034504 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0baa8a6d-7917-43a8-8976-e735367c5642 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:00.034977 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0baa8a6d-7917-43a8-8976-e735367c5642 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:00.035734 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0baa8a6d-7917-43a8-8976-e735367c5642 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:00.036164 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0baa8a6d-7917-43a8-8976-e735367c5642 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:00.165451 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-0baa8a6d-7917-43a8-8976-e735367c5642 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:00.173939 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-0baa8a6d-7917-43a8-8976-e735367c5642 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:00.175477 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-0baa8a6d-7917-43a8-8976-e735367c5642 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:00.176580 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-0baa8a6d-7917-43a8-8976-e735367c5642 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1408 microversion: 2.20 time: 0.153296 Jun 03 10:03:00.177328 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 317/635] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:03:00 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:03:00.624296 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-87f1262c-d5a7-46c1-a764-94c49790a4c6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:00.624910 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-87f1262c-d5a7-46c1-a764-94c49790a4c6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:00.631457 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-87f1262c-d5a7-46c1-a764-94c49790a4c6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:00.631957 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-87f1262c-d5a7-46c1-a764-94c49790a4c6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:00.632674 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-87f1262c-d5a7-46c1-a764-94c49790a4c6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:00.633110 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-87f1262c-d5a7-46c1-a764-94c49790a4c6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:00.665057 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-87f1262c-d5a7-46c1-a764-94c49790a4c6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:00.665507 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-87f1262c-d5a7-46c1-a764-94c49790a4c6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:00.666019 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.objects.instance [None req-87f1262c-d5a7-46c1-a764-94c49790a4c6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lazy-loading 'fault' on Instance uuid 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 {{(pid=125066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:03:00.705759 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-87f1262c-d5a7-46c1-a764-94c49790a4c6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:00.713558 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-87f1262c-d5a7-46c1-a764-94c49790a4c6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 200 len: 1328 microversion: 2.1 time: 0.093184 Jun 03 10:03:00.714165 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 319/636] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:00 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 1328 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:01.195290 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-18d29b6c-5695-4484-bb57-40ed591ca0db tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:01.196014 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-18d29b6c-5695-4484-bb57-40ed591ca0db tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:01.202932 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-18d29b6c-5695-4484-bb57-40ed591ca0db tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:01.203408 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-18d29b6c-5695-4484-bb57-40ed591ca0db tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:01.204565 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-18d29b6c-5695-4484-bb57-40ed591ca0db tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:01.205274 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-18d29b6c-5695-4484-bb57-40ed591ca0db tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:01.340748 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-18d29b6c-5695-4484-bb57-40ed591ca0db tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:01.349275 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-18d29b6c-5695-4484-bb57-40ed591ca0db tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:01.350833 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-18d29b6c-5695-4484-bb57-40ed591ca0db tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:01.352035 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-18d29b6c-5695-4484-bb57-40ed591ca0db tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1600 microversion: 2.20 time: 0.160551 Jun 03 10:03:01.352593 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 318/637] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:03:01 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:03:01.369610 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-486720bb-59fe-4dc7-a138-50405b803dcb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:01.370175 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-486720bb-59fe-4dc7-a138-50405b803dcb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:01.376156 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-486720bb-59fe-4dc7-a138-50405b803dcb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:01.376590 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-486720bb-59fe-4dc7-a138-50405b803dcb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:01.377345 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-486720bb-59fe-4dc7-a138-50405b803dcb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:01.377777 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-486720bb-59fe-4dc7-a138-50405b803dcb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:01.393132 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:SELECT=100 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:01.461137 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-486720bb-59fe-4dc7-a138-50405b803dcb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.095356 Jun 03 10:03:01.461815 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 320/638] 10.222.0.42 () {60 vars in 1315 bytes} [Fri Jun 3 10:03:01 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 10:03:01.730330 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-105a0f63-1c2b-409e-ac2b-37af69e8c0bc tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:01.730938 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-105a0f63-1c2b-409e-ac2b-37af69e8c0bc tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:01.736990 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-105a0f63-1c2b-409e-ac2b-37af69e8c0bc tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:01.737434 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-105a0f63-1c2b-409e-ac2b-37af69e8c0bc tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:01.738230 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-105a0f63-1c2b-409e-ac2b-37af69e8c0bc tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:01.738671 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-105a0f63-1c2b-409e-ac2b-37af69e8c0bc tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:01.752194 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.wsgi [None req-105a0f63-1c2b-409e-ac2b-37af69e8c0bc tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] HTTP exception thrown: Instance 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 could not be found. Jun 03 10:03:01.754107 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-105a0f63-1c2b-409e-ac2b-37af69e8c0bc tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Request method failure captured: Jun 03 10:03:01.754107 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: request: GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 HTTP/1.1 Jun 03 10:03:01.754107 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept: application/json Jun 03 10:03:01.754107 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept-Encoding: identity Jun 03 10:03:01.754107 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Connection: close Jun 03 10:03:01.754107 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Length: 0 Jun 03 10:03:01.754107 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Type: application/json Jun 03 10:03:01.754107 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Host: 10.222.0.42 Jun 03 10:03:01.754107 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Openstack-System-Scope: None Jun 03 10:03:01.754107 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: User-Agent: python-urllib3/1.26.9 Jun 03 10:03:01.754107 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Auth-Token: gAAAAABimdtBMxI1_XARv6zROzpVvCk5TBiT12tdRbdOvk6wC3oEf1-r8UmrTZdYHxthXgJhwuyEo3PRevUOlHG2OvaZyxBk3IoOTJn-eXtqweY8QkNyg2GJrJmEcGTYbKMr9Rbr20vV9fu-8zaHcMKp5wE--6uSFsvysYsmZl5fOZlY92hSGXA Jun 03 10:03:01.754107 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Id: None Jun 03 10:03:01.754107 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Name: None Jun 03 10:03:01.754107 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Identity-Status: Confirmed Jun 03 10:03:01.754107 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Is-Admin-Project: True Jun 03 10:03:01.754107 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Id: default Jun 03 10:03:01.754107 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Name: Default Jun 03 10:03:01.754107 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Id: 686f552be5824c8aa31930a6e8844255 Jun 03 10:03:01.754107 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Name: tempest-AttachVolumeTestJSON-145001499 Jun 03 10:03:01.754107 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Role: member,reader Jun 03 10:03:01.754107 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Roles: member,reader Jun 03 10:03:01.755674 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/686f552be5824c8aa31930a6e8844255"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/686f552be5824c8aa31930a6e8844255"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_686f552be5824c8aa31930a6e8844255", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/686f552be5824c8aa31930a6e8844255"}]}] Jun 03 10:03:01.755674 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant: tempest-AttachVolumeTestJSON-145001499 Jun 03 10:03:01.755674 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Id: 686f552be5824c8aa31930a6e8844255 Jun 03 10:03:01.755674 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Name: tempest-AttachVolumeTestJSON-145001499 Jun 03 10:03:01.755674 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User: tempest-AttachVolumeTestJSON-145001499-project Jun 03 10:03:01.755674 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Id: default Jun 03 10:03:01.755674 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Name: Default Jun 03 10:03:01.755674 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Id: 49efae911ef8458b9288558014217934 Jun 03 10:03:01.755674 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Name: tempest-AttachVolumeTestJSON-145001499-project Jun 03 10:03:01.755674 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: method: > Jun 03 10:03:01.755674 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: exception: Instance 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 could not be found. Jun 03 10:03:01.755674 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: action_args: {'id': '22d7bf3d-d6e9-4a78-bf74-77b44928b1d3'} Jun 03 10:03:01.756554 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:03:01.756554 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:01.756554 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:03:01.756554 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:03:01.756554 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:03:01.756554 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:03:01.756554 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:03:01.756554 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:03:01.756554 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:03:01.756554 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:03:01.756554 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 could not be found. Jun 03 10:03:01.756554 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:03:01.756554 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:01.756554 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:03:01.756554 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:01.756554 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:01.756554 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:01.756554 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:03:01.756554 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:03:01.756554 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:03:01.758061 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:03:01.758061 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:03:01.758061 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:03:01.758061 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:03:01.758061 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:03:01.758061 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:03:01.758061 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:03:01.758061 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 could not be found. Jun 03 10:03:01.758061 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:03:01.758061 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:01.758061 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:03:01.758061 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:01.758061 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:01.758061 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:01.758061 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:03:01.758061 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:03:01.758061 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 could not be found. Jun 03 10:03:01.758061 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:03:01.759342 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-105a0f63-1c2b-409e-ac2b-37af69e8c0bc tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Returning 404 to user: Instance 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 could not be found. {{(pid=125065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:03:01.759342 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-105a0f63-1c2b-409e-ac2b-37af69e8c0bc tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 404 len: 111 microversion: 2.1 time: 0.029092 Jun 03 10:03:01.759342 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 319/639] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:01 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 10:03:01.769973 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-f2eab085-17c2-4088-b39a-b45f4e37f53e tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '.version_select at 0x7f8d30b02430>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:01.852414 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-f2eab085-17c2-4088-b39a-b45f4e37f53e tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1708535609" status: 202 len: 0 microversion: 2.1 time: 0.087029 Jun 03 10:03:01.853011 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 321/640] 10.222.0.42 () {58 vars in 1220 bytes} [Fri Jun 3 10:03:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1708535609 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:03:02.437595 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-d5c55cc3-982c-403c-94e4-eee58610848b req-e5650abe-385e-4d66-a36d-fc0c0c74968f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc", "tag": "3b6360f1-9329-469d-913b-3b05fed8cd88"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:02.458538 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-d5c55cc3-982c-403c-94e4-eee58610848b req-e5650abe-385e-4d66-a36d-fc0c0c74968f service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:02.458984 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-d5c55cc3-982c-403c-94e4-eee58610848b req-e5650abe-385e-4d66-a36d-fc0c0c74968f service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:02.470381 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-d5c55cc3-982c-403c-94e4-eee58610848b req-e5650abe-385e-4d66-a36d-fc0c0c74968f service nova] Creating event network-changed:3b6360f1-9329-469d-913b-3b05fed8cd88 for instance a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc on hv-cinder-84456 Jun 03 10:03:02.475394 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-d5c55cc3-982c-403c-94e4-eee58610848b req-e5650abe-385e-4d66-a36d-fc0c0c74968f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042011 Jun 03 10:03:02.476084 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 320/641] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:03:02.836029 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-40c83cc6-69fa-4e93-bfb8-e813580b0fba tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Action: 'create', calling method: .version_select at 0x7f8d23e17310>, body: {"keypair": {"name": "tempest-keypair-712776769", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxzdRg57UBx7yRC+woEGVB+QAJfxwWooOfLH7R2kEXLEsv2ow3v/KEWZmxzZTbAPNdpcgRJ3LyBuTXWKO8Q6XY62MK37KEZPz103C1bKABDR98m6rsW8L9sk7f+yb/p7w=="}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:02.850845 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-40c83cc6-69fa-4e93-bfb8-e813580b0fba tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Getting quotas for project 686f552be5824c8aa31930a6e8844255. Resources: {'key_pairs'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:03:02.854669 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-40c83cc6-69fa-4e93-bfb8-e813580b0fba tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Getting quotas for user 49efae911ef8458b9288558014217934 and project 686f552be5824c8aa31930a6e8844255. Resources: {'key_pairs'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:03:02.944540 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-40c83cc6-69fa-4e93-bfb8-e813580b0fba tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.112817 Jun 03 10:03:02.945304 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 322/642] 10.222.0.42 () {60 vars in 1158 bytes} [Fri Jun 3 10:03:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:03:04.789241 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-d40fa720-818a-4196-b9ad-fab43ae32c54 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:04.790006 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-d40fa720-818a-4196-b9ad-fab43ae32c54 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:04.796611 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d40fa720-818a-4196-b9ad-fab43ae32c54 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:04.797065 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d40fa720-818a-4196-b9ad-fab43ae32c54 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:04.797837 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d40fa720-818a-4196-b9ad-fab43ae32c54 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:04.798300 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d40fa720-818a-4196-b9ad-fab43ae32c54 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:04.881421 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.objects.instance [None req-d40fa720-818a-4196-b9ad-fab43ae32c54 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lazy-loading 'services' on Instance uuid 5809214c-e01c-4ff2-adbf-097cf27a9846 {{(pid=125065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:03:05.144782 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-d40fa720-818a-4196-b9ad-fab43ae32c54 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846/os-volume_attachments/b142ba7a-2b86-4787-a88e-4dc3d25cbf03" status: 202 len: 0 microversion: 2.1 time: 0.360414 Jun 03 10:03:05.146093 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 321/643] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jun 3 10:03:04 2022] DELETE /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846/os-volume_attachments/b142ba7a-2b86-4787-a88e-4dc3d25cbf03 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:03:05.158929 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-08a52d09-563e-4d42-96e6-a2612a328055 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:05.160530 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-08a52d09-563e-4d42-96e6-a2612a328055 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:05.170736 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-08a52d09-563e-4d42-96e6-a2612a328055 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:05.171434 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-08a52d09-563e-4d42-96e6-a2612a328055 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:05.172208 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-08a52d09-563e-4d42-96e6-a2612a328055 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:05.172646 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-08a52d09-563e-4d42-96e6-a2612a328055 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:05.219733 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-08a52d09-563e-4d42-96e6-a2612a328055 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069555 Jun 03 10:03:05.221097 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 323/644] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 3 10:03:05 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:03:05.441806 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-e7ae128a-2ec8-4d3f-9798-ef72079f8d4a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2067643860", "imageRef": "0d2dd03b-4531-46f3-88da-0380e97b1bd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1b8baf95-875c-4b35-b8da-e86b3e7dbe4a"}], "security_groups": [{"name": "tempest-securitygroup--1563844344"}], "key_name": "tempest-keypair-712776769", "user_data": "}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:05.546247 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.network.neutron [None req-e7ae128a-2ec8-4d3f-9798-ef72079f8d4a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] validate_networks() for [('1b8baf95-875c-4b35-b8da-e86b3e7dbe4a', None, None, None, None, None)] {{(pid=125065) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 10:03:06.152915 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-e7ae128a-2ec8-4d3f-9798-ef72079f8d4a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Flavor limits 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 10:03:06.153542 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-e7ae128a-2ec8-4d3f-9798-ef72079f8d4a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Image limits 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 10:03:06.153779 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-e7ae128a-2ec8-4d3f-9798-ef72079f8d4a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Flavor pref 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 10:03:06.154211 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-e7ae128a-2ec8-4d3f-9798-ef72079f8d4a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Image pref 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 10:03:06.159764 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-e7ae128a-2ec8-4d3f-9798-ef72079f8d4a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 10:03:06.163914 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e7ae128a-2ec8-4d3f-9798-ef72079f8d4a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:06.164360 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e7ae128a-2ec8-4d3f-9798-ef72079f8d4a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:06.165145 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e7ae128a-2ec8-4d3f-9798-ef72079f8d4a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:06.165571 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e7ae128a-2ec8-4d3f-9798-ef72079f8d4a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:06.183155 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.quota [None req-e7ae128a-2ec8-4d3f-9798-ef72079f8d4a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Getting quotas for project 686f552be5824c8aa31930a6e8844255. Resources: {'ram', 'instances', 'cores'} {{(pid=125065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:03:06.188396 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.quota [None req-e7ae128a-2ec8-4d3f-9798-ef72079f8d4a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Getting quotas for user 49efae911ef8458b9288558014217934 and project 686f552be5824c8aa31930a6e8844255. Resources: {'ram', 'instances', 'cores'} {{(pid=125065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:03:06.198418 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-e7ae128a-2ec8-4d3f-9798-ef72079f8d4a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Going to run 1 instances... {{(pid=125065) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 10:03:06.200866 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-e7ae128a-2ec8-4d3f-9798-ef72079f8d4a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2dd03b-4531-46f3-88da-0380e97b1bd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 10:03:06.231680 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-8e54f581-85c4-4d47-a74a-7267e272dfa7 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:06.232501 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-8e54f581-85c4-4d47-a74a-7267e272dfa7 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:06.239596 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8e54f581-85c4-4d47-a74a-7267e272dfa7 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:06.241614 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8e54f581-85c4-4d47-a74a-7267e272dfa7 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:06.241614 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8e54f581-85c4-4d47-a74a-7267e272dfa7 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:06.241614 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8e54f581-85c4-4d47-a74a-7267e272dfa7 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:06.271110 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-8e54f581-85c4-4d47-a74a-7267e272dfa7 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043334 Jun 03 10:03:06.271681 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 324/645] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 3 10:03:06 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:03:06.344776 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-e7ae128a-2ec8-4d3f-9798-ef72079f8d4a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.908430 Jun 03 10:03:06.345416 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 322/646] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 3 10:03:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 10:03:06.355493 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-a5ae4ce3-f1c7-4aa5-9264-5c311ae56b9a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:06.356107 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-a5ae4ce3-f1c7-4aa5-9264-5c311ae56b9a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:06.411702 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-a5ae4ce3-f1c7-4aa5-9264-5c311ae56b9a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:06.418485 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-a5ae4ce3-f1c7-4aa5-9264-5c311ae56b9a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f" status: 200 len: 1237 microversion: 2.1 time: 0.067032 Jun 03 10:03:06.419051 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 325/647] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:06 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:07.283755 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-69b515c0-41fc-4cc9-96bd-e378ee47fc7f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:07.284718 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-69b515c0-41fc-4cc9-96bd-e378ee47fc7f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:07.291839 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-69b515c0-41fc-4cc9-96bd-e378ee47fc7f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:07.292296 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-69b515c0-41fc-4cc9-96bd-e378ee47fc7f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:07.293065 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-69b515c0-41fc-4cc9-96bd-e378ee47fc7f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:07.293505 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-69b515c0-41fc-4cc9-96bd-e378ee47fc7f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:07.325098 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-69b515c0-41fc-4cc9-96bd-e378ee47fc7f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046325 Jun 03 10:03:07.325655 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 323/648] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 3 10:03:07 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 10:03:07.399381 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-36e23ba9-b820-4dfe-b06f-2c82f4308f7e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:07.399915 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-36e23ba9-b820-4dfe-b06f-2c82f4308f7e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:07.407086 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-36e23ba9-b820-4dfe-b06f-2c82f4308f7e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:07.411657 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-36e23ba9-b820-4dfe-b06f-2c82f4308f7e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:07.411657 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-36e23ba9-b820-4dfe-b06f-2c82f4308f7e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:07.411657 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-36e23ba9-b820-4dfe-b06f-2c82f4308f7e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:07.435724 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-36e23ba9-b820-4dfe-b06f-2c82f4308f7e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Going to try to terminate instance {{(pid=125066) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:03:07.436354 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-c5383aaa-aa9d-4d0e-add6-a5dce591f85e tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:07.436958 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-c5383aaa-aa9d-4d0e-add6-a5dce591f85e tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:07.443395 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c5383aaa-aa9d-4d0e-add6-a5dce591f85e tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:07.444106 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c5383aaa-aa9d-4d0e-add6-a5dce591f85e tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:07.444854 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c5383aaa-aa9d-4d0e-add6-a5dce591f85e tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:07.445291 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c5383aaa-aa9d-4d0e-add6-a5dce591f85e tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:07.464307 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:07.506816 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-c5383aaa-aa9d-4d0e-add6-a5dce591f85e tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:07.514481 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-c5383aaa-aa9d-4d0e-add6-a5dce591f85e tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f" status: 200 len: 1233 microversion: 2.1 time: 0.081886 Jun 03 10:03:07.515055 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 324/649] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:07 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f => generated 1233 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:07.783032 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-36e23ba9-b820-4dfe-b06f-2c82f4308f7e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 204 len: 0 microversion: 2.1 time: 0.387352 Jun 03 10:03:07.783689 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 326/650] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 3 10:03:07 2022] DELETE /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:03:07.792131 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-2b4b302e-5db0-4cf5-8907-5e0d8ad28e66 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:07.792730 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-2b4b302e-5db0-4cf5-8907-5e0d8ad28e66 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:07.799279 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2b4b302e-5db0-4cf5-8907-5e0d8ad28e66 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:07.799731 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2b4b302e-5db0-4cf5-8907-5e0d8ad28e66 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:07.800482 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2b4b302e-5db0-4cf5-8907-5e0d8ad28e66 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:07.800908 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2b4b302e-5db0-4cf5-8907-5e0d8ad28e66 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:07.930617 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-2b4b302e-5db0-4cf5-8907-5e0d8ad28e66 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:07.938103 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-2b4b302e-5db0-4cf5-8907-5e0d8ad28e66 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1689 microversion: 2.1 time: 0.150168 Jun 03 10:03:07.938673 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 325/651] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:07 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:08.531902 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-af382c08-a467-490d-bba3-60e94ad40278 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:08.532601 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-af382c08-a467-490d-bba3-60e94ad40278 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:08.539202 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-af382c08-a467-490d-bba3-60e94ad40278 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:08.539653 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-af382c08-a467-490d-bba3-60e94ad40278 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:08.540464 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-af382c08-a467-490d-bba3-60e94ad40278 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:08.540897 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-af382c08-a467-490d-bba3-60e94ad40278 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:08.603433 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-af382c08-a467-490d-bba3-60e94ad40278 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:08.611457 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-af382c08-a467-490d-bba3-60e94ad40278 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f" status: 200 len: 1289 microversion: 2.1 time: 0.083889 Jun 03 10:03:08.612028 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 327/652] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:08 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f => generated 1289 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:08.954461 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-577136b4-3533-4f04-b0fb-833bbf64e101 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:08.955069 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-577136b4-3533-4f04-b0fb-833bbf64e101 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:08.961586 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-577136b4-3533-4f04-b0fb-833bbf64e101 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:08.962092 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-577136b4-3533-4f04-b0fb-833bbf64e101 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:08.962858 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-577136b4-3533-4f04-b0fb-833bbf64e101 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:08.963293 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-577136b4-3533-4f04-b0fb-833bbf64e101 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:09.089540 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-577136b4-3533-4f04-b0fb-833bbf64e101 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:09.097490 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-577136b4-3533-4f04-b0fb-833bbf64e101 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1689 microversion: 2.1 time: 0.146915 Jun 03 10:03:09.098091 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 326/653] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:08 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1689 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:03:09.237663 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-2162b18d-25c8-41e4-b450-5d5033182fbc tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:09.238194 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-2162b18d-25c8-41e4-b450-5d5033182fbc tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: f21c35e4-2a21-41c4-91bb-e28a3a75fb35] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:09.244274 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2162b18d-25c8-41e4-b450-5d5033182fbc tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:09.244729 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2162b18d-25c8-41e4-b450-5d5033182fbc tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:09.245491 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2162b18d-25c8-41e4-b450-5d5033182fbc tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:09.245955 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2162b18d-25c8-41e4-b450-5d5033182fbc tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:09.323466 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.objects.instance [None req-2162b18d-25c8-41e4-b450-5d5033182fbc tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lazy-loading 'services' on Instance uuid f21c35e4-2a21-41c4-91bb-e28a3a75fb35 {{(pid=125066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:03:09.519374 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-2162b18d-25c8-41e4-b450-5d5033182fbc tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35/os-volume_attachments/52a53fe4-3253-4d3e-9e19-84ad837f84e2" status: 202 len: 0 microversion: 2.1 time: 0.285474 Jun 03 10:03:09.519963 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 328/654] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jun 3 10:03:09 2022] DELETE /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35/os-volume_attachments/52a53fe4-3253-4d3e-9e19-84ad837f84e2 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:03:09.628496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-c6f0241f-5c4d-4e1c-a013-8f5434f4d0f5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:09.629095 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-c6f0241f-5c4d-4e1c-a013-8f5434f4d0f5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:09.635523 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c6f0241f-5c4d-4e1c-a013-8f5434f4d0f5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:09.635976 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c6f0241f-5c4d-4e1c-a013-8f5434f4d0f5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:09.636718 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c6f0241f-5c4d-4e1c-a013-8f5434f4d0f5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:09.637143 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c6f0241f-5c4d-4e1c-a013-8f5434f4d0f5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:09.700469 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-c6f0241f-5c4d-4e1c-a013-8f5434f4d0f5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:09.708427 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-c6f0241f-5c4d-4e1c-a013-8f5434f4d0f5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f" status: 200 len: 1289 microversion: 2.1 time: 0.083838 Jun 03 10:03:09.708978 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 327/655] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:09 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f => generated 1289 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:10.115373 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-ed67fed9-72a8-47e2-bfe1-9951cf999714 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:10.116064 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-ed67fed9-72a8-47e2-bfe1-9951cf999714 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:10.122392 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ed67fed9-72a8-47e2-bfe1-9951cf999714 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:10.122837 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ed67fed9-72a8-47e2-bfe1-9951cf999714 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:10.124241 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ed67fed9-72a8-47e2-bfe1-9951cf999714 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:10.124675 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ed67fed9-72a8-47e2-bfe1-9951cf999714 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:10.251528 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-ed67fed9-72a8-47e2-bfe1-9951cf999714 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:10.259010 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-ed67fed9-72a8-47e2-bfe1-9951cf999714 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1689 microversion: 2.1 time: 0.148359 Jun 03 10:03:10.259838 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 329/656] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:10 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:10.724462 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-ed857da2-3878-48f3-acfa-334ca0bf19d5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:10.725096 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-ed857da2-3878-48f3-acfa-334ca0bf19d5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:10.731647 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ed857da2-3878-48f3-acfa-334ca0bf19d5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:10.732092 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ed857da2-3878-48f3-acfa-334ca0bf19d5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:10.732921 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ed857da2-3878-48f3-acfa-334ca0bf19d5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:10.733355 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ed857da2-3878-48f3-acfa-334ca0bf19d5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:10.796361 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-ed857da2-3878-48f3-acfa-334ca0bf19d5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:10.804125 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-ed857da2-3878-48f3-acfa-334ca0bf19d5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f" status: 200 len: 1289 microversion: 2.1 time: 0.083446 Jun 03 10:03:10.805084 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 328/657] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:10 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f => generated 1289 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:11.276229 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-f5998983-5a4f-43d6-9597-3c60ed44ce0b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:11.276795 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-f5998983-5a4f-43d6-9597-3c60ed44ce0b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:11.283305 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f5998983-5a4f-43d6-9597-3c60ed44ce0b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:11.290284 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f5998983-5a4f-43d6-9597-3c60ed44ce0b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:11.290284 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f5998983-5a4f-43d6-9597-3c60ed44ce0b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:11.290284 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f5998983-5a4f-43d6-9597-3c60ed44ce0b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:11.414199 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-f5998983-5a4f-43d6-9597-3c60ed44ce0b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:11.422205 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-f5998983-5a4f-43d6-9597-3c60ed44ce0b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1689 microversion: 2.1 time: 0.149934 Jun 03 10:03:11.422781 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 330/658] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:11 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:03:11.821205 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-02eda689-7c5f-4e7d-8376-0aea33b045c5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:11.821820 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-02eda689-7c5f-4e7d-8376-0aea33b045c5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:11.828349 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-02eda689-7c5f-4e7d-8376-0aea33b045c5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:11.828791 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-02eda689-7c5f-4e7d-8376-0aea33b045c5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:11.829537 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-02eda689-7c5f-4e7d-8376-0aea33b045c5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:11.829987 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-02eda689-7c5f-4e7d-8376-0aea33b045c5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:11.891838 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-02eda689-7c5f-4e7d-8376-0aea33b045c5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:11.899536 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-02eda689-7c5f-4e7d-8376-0aea33b045c5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f" status: 200 len: 1289 microversion: 2.1 time: 0.082231 Jun 03 10:03:11.900117 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 329/659] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:11 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f => generated 1289 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:12.440891 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-3c84999f-7b86-49c0-b330-e15d8d772e70 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:12.441502 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-3c84999f-7b86-49c0-b330-e15d8d772e70 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:12.449996 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3c84999f-7b86-49c0-b330-e15d8d772e70 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:12.450708 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3c84999f-7b86-49c0-b330-e15d8d772e70 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:12.452242 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3c84999f-7b86-49c0-b330-e15d8d772e70 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:12.452932 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3c84999f-7b86-49c0-b330-e15d8d772e70 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:12.876395 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-3c84999f-7b86-49c0-b330-e15d8d772e70 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:12.884060 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-3c84999f-7b86-49c0-b330-e15d8d772e70 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1689 microversion: 2.1 time: 0.448258 Jun 03 10:03:12.886787 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 331/660] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:12 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1689 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:12.916998 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-3267af7a-e0cd-49cd-8cb9-1b88d89709b7 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:12.917732 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-3267af7a-e0cd-49cd-8cb9-1b88d89709b7 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:12.924853 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3267af7a-e0cd-49cd-8cb9-1b88d89709b7 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:12.925310 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3267af7a-e0cd-49cd-8cb9-1b88d89709b7 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:12.926142 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3267af7a-e0cd-49cd-8cb9-1b88d89709b7 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:12.926580 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3267af7a-e0cd-49cd-8cb9-1b88d89709b7 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:13.071941 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-3267af7a-e0cd-49cd-8cb9-1b88d89709b7 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:13.080036 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-3267af7a-e0cd-49cd-8cb9-1b88d89709b7 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f" status: 200 len: 1295 microversion: 2.1 time: 0.166918 Jun 03 10:03:13.085070 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 330/661] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:12 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f => generated 1295 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:13.794374 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-1afed55c-31aa-4b67-a10d-3141afa0b221 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:13.794882 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-1afed55c-31aa-4b67-a10d-3141afa0b221 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: f21c35e4-2a21-41c4-91bb-e28a3a75fb35] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:13.802695 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1afed55c-31aa-4b67-a10d-3141afa0b221 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:13.803367 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1afed55c-31aa-4b67-a10d-3141afa0b221 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:13.804418 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1afed55c-31aa-4b67-a10d-3141afa0b221 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:13.805090 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1afed55c-31aa-4b67-a10d-3141afa0b221 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:13.831639 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-1afed55c-31aa-4b67-a10d-3141afa0b221 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: f21c35e4-2a21-41c4-91bb-e28a3a75fb35] Going to try to terminate instance {{(pid=125066) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:03:13.871339 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-21aba0ce-6505-47e6-ba3b-a86d8f226dd4 req-99fc58a7-e093-4121-a8af-d48a916ecc71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5809214c-e01c-4ff2-adbf-097cf27a9846", "name": "network-vif-deleted", "tag": "fce52c81-17cf-4133-980e-d0dda0f0288a"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:13.886005 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-21aba0ce-6505-47e6-ba3b-a86d8f226dd4 req-99fc58a7-e093-4121-a8af-d48a916ecc71 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:13.886458 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-21aba0ce-6505-47e6-ba3b-a86d8f226dd4 req-99fc58a7-e093-4121-a8af-d48a916ecc71 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:13.898995 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-21aba0ce-6505-47e6-ba3b-a86d8f226dd4 req-99fc58a7-e093-4121-a8af-d48a916ecc71 service nova] Creating event network-vif-deleted:fce52c81-17cf-4133-980e-d0dda0f0288a for instance 5809214c-e01c-4ff2-adbf-097cf27a9846 on hv-cinder-84456 Jun 03 10:03:13.906297 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-21aba0ce-6505-47e6-ba3b-a86d8f226dd4 req-99fc58a7-e093-4121-a8af-d48a916ecc71 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039089 Jun 03 10:03:13.907261 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 331/662] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:03:13.914105 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-36bebdeb-2bae-4b88-ae23-49f2fb3ec25f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:13.917282 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-36bebdeb-2bae-4b88-ae23-49f2fb3ec25f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:13.924086 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-36bebdeb-2bae-4b88-ae23-49f2fb3ec25f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:13.924679 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-36bebdeb-2bae-4b88-ae23-49f2fb3ec25f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:13.925563 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-36bebdeb-2bae-4b88-ae23-49f2fb3ec25f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:13.926302 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-36bebdeb-2bae-4b88-ae23-49f2fb3ec25f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:14.039884 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-36bebdeb-2bae-4b88-ae23-49f2fb3ec25f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:14.052743 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-36bebdeb-2bae-4b88-ae23-49f2fb3ec25f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1621 microversion: 2.1 time: 0.144049 Jun 03 10:03:14.053616 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 332/663] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:13 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1621 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:14.101237 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-c0043c44-de47-48f5-8742-d4757427d571 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:14.102149 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-c0043c44-de47-48f5-8742-d4757427d571 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:14.110557 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c0043c44-de47-48f5-8742-d4757427d571 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:14.112260 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c0043c44-de47-48f5-8742-d4757427d571 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:14.112857 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c0043c44-de47-48f5-8742-d4757427d571 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:14.114483 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c0043c44-de47-48f5-8742-d4757427d571 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:14.319466 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-1afed55c-31aa-4b67-a10d-3141afa0b221 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35" status: 204 len: 0 microversion: 2.1 time: 0.528571 Jun 03 10:03:14.320408 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 332/664] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 3 10:03:13 2022] DELETE /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:03:14.330452 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-bfab331c-05c1-4205-aea2-92b26ee6aae2 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:14.331165 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-bfab331c-05c1-4205-aea2-92b26ee6aae2 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: f21c35e4-2a21-41c4-91bb-e28a3a75fb35] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:14.337732 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bfab331c-05c1-4205-aea2-92b26ee6aae2 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:14.338345 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bfab331c-05c1-4205-aea2-92b26ee6aae2 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:14.339288 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bfab331c-05c1-4205-aea2-92b26ee6aae2 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:14.339869 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bfab331c-05c1-4205-aea2-92b26ee6aae2 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:14.404387 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-c0043c44-de47-48f5-8742-d4757427d571 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:14.413162 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-c0043c44-de47-48f5-8742-d4757427d571 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f" status: 200 len: 1363 microversion: 2.1 time: 0.320173 Jun 03 10:03:14.413822 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 333/665] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:14 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f => generated 1363 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:14.564058 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-bfab331c-05c1-4205-aea2-92b26ee6aae2 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:14.571627 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-bfab331c-05c1-4205-aea2-92b26ee6aae2 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35" status: 200 len: 1512 microversion: 2.1 time: 0.246481 Jun 03 10:03:14.572210 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 333/666] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:14 2022] GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35 => generated 1512 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:15.070670 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-3048bd99-617e-4a8e-a6d3-fef9246f959f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:15.072021 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-3048bd99-617e-4a8e-a6d3-fef9246f959f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:15.079790 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3048bd99-617e-4a8e-a6d3-fef9246f959f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:15.080231 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3048bd99-617e-4a8e-a6d3-fef9246f959f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:15.081000 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3048bd99-617e-4a8e-a6d3-fef9246f959f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:15.081433 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3048bd99-617e-4a8e-a6d3-fef9246f959f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:15.116746 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3048bd99-617e-4a8e-a6d3-fef9246f959f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:15.117195 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3048bd99-617e-4a8e-a6d3-fef9246f959f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:15.117641 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.objects.instance [None req-3048bd99-617e-4a8e-a6d3-fef9246f959f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lazy-loading 'fault' on Instance uuid 5809214c-e01c-4ff2-adbf-097cf27a9846 {{(pid=125065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:03:15.167118 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-3048bd99-617e-4a8e-a6d3-fef9246f959f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:15.170748 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-3048bd99-617e-4a8e-a6d3-fef9246f959f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1336 microversion: 2.1 time: 0.103954 Jun 03 10:03:15.171314 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 334/667] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:15 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1336 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:15.430512 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-e5db5ae0-c210-4652-8360-e1cdf90ed55b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:15.431122 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-e5db5ae0-c210-4652-8360-e1cdf90ed55b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:15.437639 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e5db5ae0-c210-4652-8360-e1cdf90ed55b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:15.438132 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e5db5ae0-c210-4652-8360-e1cdf90ed55b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:15.438889 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e5db5ae0-c210-4652-8360-e1cdf90ed55b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:15.439327 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e5db5ae0-c210-4652-8360-e1cdf90ed55b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:15.567702 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-e5db5ae0-c210-4652-8360-e1cdf90ed55b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:15.575211 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-e5db5ae0-c210-4652-8360-e1cdf90ed55b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f" status: 200 len: 1363 microversion: 2.1 time: 0.148556 Jun 03 10:03:15.575776 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 334/668] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:15 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:15.588305 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-c42bd2c1-9856-4ca8-844a-d22f6ff39fa6 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:15.588910 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-c42bd2c1-9856-4ca8-844a-d22f6ff39fa6 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: f21c35e4-2a21-41c4-91bb-e28a3a75fb35] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:15.594891 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c42bd2c1-9856-4ca8-844a-d22f6ff39fa6 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:15.595336 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c42bd2c1-9856-4ca8-844a-d22f6ff39fa6 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:15.596115 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c42bd2c1-9856-4ca8-844a-d22f6ff39fa6 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:15.596576 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c42bd2c1-9856-4ca8-844a-d22f6ff39fa6 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:15.724973 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-c42bd2c1-9856-4ca8-844a-d22f6ff39fa6 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:15.732312 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-c42bd2c1-9856-4ca8-844a-d22f6ff39fa6 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35" status: 200 len: 1512 microversion: 2.1 time: 0.147798 Jun 03 10:03:15.732880 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 335/669] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:15 2022] GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35 => generated 1512 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:15.967100 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-e68963b9-f954-4a79-b00d-6b3022f9ef2e req-17e2bdd7-e298-40e2-b1b5-7058b1fbcd01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbff6766-51d9-41a5-b9f9-bdb117cad35f", "tag": "13121560-48ad-4ce7-91f1-cace26c579e9"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:15.975161 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-e68963b9-f954-4a79-b00d-6b3022f9ef2e req-17e2bdd7-e298-40e2-b1b5-7058b1fbcd01 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:15.975603 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-e68963b9-f954-4a79-b00d-6b3022f9ef2e req-17e2bdd7-e298-40e2-b1b5-7058b1fbcd01 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:15.986468 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-e68963b9-f954-4a79-b00d-6b3022f9ef2e req-17e2bdd7-e298-40e2-b1b5-7058b1fbcd01 service nova] Creating event network-changed:13121560-48ad-4ce7-91f1-cace26c579e9 for instance cbff6766-51d9-41a5-b9f9-bdb117cad35f on hv-cinder-84456 Jun 03 10:03:15.991113 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-e68963b9-f954-4a79-b00d-6b3022f9ef2e req-17e2bdd7-e298-40e2-b1b5-7058b1fbcd01 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027735 Jun 03 10:03:15.991671 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 335/670] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:03:16.188329 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-6381186b-fafc-42f9-b164-59f2252b7bc2 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:16.188959 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-6381186b-fafc-42f9-b164-59f2252b7bc2 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:16.191612 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell0:SELECT=2 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:16.195208 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell0:SELECT=6 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:16.197171 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6381186b-fafc-42f9-b164-59f2252b7bc2 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:16.197810 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6381186b-fafc-42f9-b164-59f2252b7bc2 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:16.198599 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6381186b-fafc-42f9-b164-59f2252b7bc2 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:16.199031 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6381186b-fafc-42f9-b164-59f2252b7bc2 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:16.230130 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6381186b-fafc-42f9-b164-59f2252b7bc2 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:16.230497 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6381186b-fafc-42f9-b164-59f2252b7bc2 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:16.230935 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.objects.instance [None req-6381186b-fafc-42f9-b164-59f2252b7bc2 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lazy-loading 'fault' on Instance uuid 5809214c-e01c-4ff2-adbf-097cf27a9846 {{(pid=125065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:03:16.270932 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-6381186b-fafc-42f9-b164-59f2252b7bc2 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:16.278764 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-6381186b-fafc-42f9-b164-59f2252b7bc2 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 200 len: 1336 microversion: 2.1 time: 0.094897 Jun 03 10:03:16.279329 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 336/671] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:16 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 1336 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:03:16.593135 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-fab7d55e-67db-48e2-a2ed-a6ae27b1d4d2 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:16.593960 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-fab7d55e-67db-48e2-a2ed-a6ae27b1d4d2 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:16.596056 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell0:SELECT=6 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:16.601944 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fab7d55e-67db-48e2-a2ed-a6ae27b1d4d2 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:16.602627 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fab7d55e-67db-48e2-a2ed-a6ae27b1d4d2 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:16.603602 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fab7d55e-67db-48e2-a2ed-a6ae27b1d4d2 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:16.604044 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fab7d55e-67db-48e2-a2ed-a6ae27b1d4d2 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:16.749433 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-910a994b-8189-47f3-8fec-3e8e7899c9ca tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:16.750102 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-910a994b-8189-47f3-8fec-3e8e7899c9ca tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: f21c35e4-2a21-41c4-91bb-e28a3a75fb35] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:16.756765 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-910a994b-8189-47f3-8fec-3e8e7899c9ca tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:16.756936 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-910a994b-8189-47f3-8fec-3e8e7899c9ca tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:16.757612 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-910a994b-8189-47f3-8fec-3e8e7899c9ca tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:16.758073 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-910a994b-8189-47f3-8fec-3e8e7899c9ca tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:16.997518 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-fab7d55e-67db-48e2-a2ed-a6ae27b1d4d2 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:17.006739 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-fab7d55e-67db-48e2-a2ed-a6ae27b1d4d2 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f" status: 200 len: 1363 microversion: 2.1 time: 0.418466 Jun 03 10:03:17.007334 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 336/672] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:16 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f => generated 1363 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:17.112874 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-910a994b-8189-47f3-8fec-3e8e7899c9ca tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:17.120665 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-910a994b-8189-47f3-8fec-3e8e7899c9ca tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35" status: 200 len: 1512 microversion: 2.1 time: 0.375443 Jun 03 10:03:17.121231 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 337/673] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:16 2022] GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35 => generated 1512 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:03:17.296328 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-d0570eb0-84ef-4cf3-8ce9-eff31c7b28b0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:17.296942 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-d0570eb0-84ef-4cf3-8ce9-eff31c7b28b0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 5809214c-e01c-4ff2-adbf-097cf27a9846] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:17.303182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d0570eb0-84ef-4cf3-8ce9-eff31c7b28b0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:17.303632 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d0570eb0-84ef-4cf3-8ce9-eff31c7b28b0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:17.304389 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d0570eb0-84ef-4cf3-8ce9-eff31c7b28b0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:17.304907 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d0570eb0-84ef-4cf3-8ce9-eff31c7b28b0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:17.308780 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:17.319408 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.wsgi [None req-d0570eb0-84ef-4cf3-8ce9-eff31c7b28b0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] HTTP exception thrown: Instance 5809214c-e01c-4ff2-adbf-097cf27a9846 could not be found. Jun 03 10:03:17.321236 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-d0570eb0-84ef-4cf3-8ce9-eff31c7b28b0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Request method failure captured: Jun 03 10:03:17.321236 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: request: GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 HTTP/1.1 Jun 03 10:03:17.321236 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept: application/json Jun 03 10:03:17.321236 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept-Encoding: identity Jun 03 10:03:17.321236 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Connection: close Jun 03 10:03:17.321236 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Length: 0 Jun 03 10:03:17.321236 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Type: application/json Jun 03 10:03:17.321236 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Host: 10.222.0.42 Jun 03 10:03:17.321236 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Openstack-System-Scope: None Jun 03 10:03:17.321236 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: User-Agent: python-urllib3/1.26.9 Jun 03 10:03:17.321236 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Auth-Token: gAAAAABimds_lF-taAYQo6OqoH0o0qi_k4NNuMaAcWJ32OQUNw2FlKeLvYNXSQEH9BN_rrTQvUY_gre2GoIt-GajpX5LOw35Rcbqj_XeR_tQGE2UjgXtf1IV-n56Dfe8ZzhxcJSCI1WvNiH6DeAg_ruh1xJPuTtCWLGR6KAI-13SXw4-Q7nABOE Jun 03 10:03:17.321236 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Id: None Jun 03 10:03:17.321236 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Name: None Jun 03 10:03:17.321236 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Identity-Status: Confirmed Jun 03 10:03:17.321236 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Is-Admin-Project: True Jun 03 10:03:17.321236 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Id: default Jun 03 10:03:17.321236 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Name: Default Jun 03 10:03:17.321236 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Id: 071b399988474af1a1c709aac97c1744 Jun 03 10:03:17.321236 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1884263324 Jun 03 10:03:17.321236 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Role: member,reader Jun 03 10:03:17.321236 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Roles: member,reader Jun 03 10:03:17.322660 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/071b399988474af1a1c709aac97c1744"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/071b399988474af1a1c709aac97c1744"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_071b399988474af1a1c709aac97c1744", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/071b399988474af1a1c709aac97c1744"}]}] Jun 03 10:03:17.322660 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1884263324 Jun 03 10:03:17.322660 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Id: 071b399988474af1a1c709aac97c1744 Jun 03 10:03:17.322660 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1884263324 Jun 03 10:03:17.322660 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User: tempest-ServerRescueNegativeTestJSON-1884263324-project Jun 03 10:03:17.322660 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Id: default Jun 03 10:03:17.322660 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Name: Default Jun 03 10:03:17.322660 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Id: 6113d715500240098217caf641db763a Jun 03 10:03:17.322660 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1884263324-project Jun 03 10:03:17.322660 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: method: > Jun 03 10:03:17.322660 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: exception: Instance 5809214c-e01c-4ff2-adbf-097cf27a9846 could not be found. Jun 03 10:03:17.322660 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: action_args: {'id': '5809214c-e01c-4ff2-adbf-097cf27a9846'} Jun 03 10:03:17.323519 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:03:17.323519 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:17.323519 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:03:17.323519 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:03:17.323519 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:03:17.323519 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:03:17.323519 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:03:17.323519 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:03:17.323519 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:03:17.323519 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:03:17.323519 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5809214c-e01c-4ff2-adbf-097cf27a9846 could not be found. Jun 03 10:03:17.323519 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:03:17.323519 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:17.323519 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:03:17.323519 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:17.323519 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:17.323519 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:17.323519 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:03:17.323519 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:03:17.323519 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:03:17.326130 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:03:17.326130 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:03:17.326130 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:03:17.326130 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:03:17.326130 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:03:17.326130 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:03:17.326130 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:03:17.326130 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5809214c-e01c-4ff2-adbf-097cf27a9846 could not be found. Jun 03 10:03:17.326130 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:03:17.326130 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:17.326130 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:03:17.326130 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:17.326130 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:17.326130 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:17.326130 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:03:17.326130 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:03:17.326130 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5809214c-e01c-4ff2-adbf-097cf27a9846 could not be found. Jun 03 10:03:17.326130 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:03:17.328985 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-d0570eb0-84ef-4cf3-8ce9-eff31c7b28b0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Returning 404 to user: Instance 5809214c-e01c-4ff2-adbf-097cf27a9846 could not be found. {{(pid=125066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:03:17.328985 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-d0570eb0-84ef-4cf3-8ce9-eff31c7b28b0 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846" status: 404 len: 111 microversion: 2.1 time: 0.030862 Jun 03 10:03:17.328985 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 337/674] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:17 2022] GET /compute/v2.1/servers/5809214c-e01c-4ff2-adbf-097cf27a9846 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:03:17.334108 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-805c8464-a3ee-4179-8a0f-fb81884dca9b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '.version_select at 0x7f8d23726af0>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:17.417064 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-805c8464-a3ee-4179-8a0f-fb81884dca9b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1298222962" status: 202 len: 0 microversion: 2.1 time: 0.087377 Jun 03 10:03:17.417672 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 338/675] 10.222.0.42 () {58 vars in 1220 bytes} [Fri Jun 3 10:03:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1298222962 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:03:18.005381 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-a8908066-482a-480d-b9b0-3ceaa46e0b2c req-bc73091b-8639-4c1e-ad21-51566482b4e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f21c35e4-2a21-41c4-91bb-e28a3a75fb35", "name": "network-vif-deleted", "tag": "f21d0899-8240-4786-a3d8-13e5ab18a6a5"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:18.014490 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-a8908066-482a-480d-b9b0-3ceaa46e0b2c req-bc73091b-8639-4c1e-ad21-51566482b4e8 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:18.014934 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-a8908066-482a-480d-b9b0-3ceaa46e0b2c req-bc73091b-8639-4c1e-ad21-51566482b4e8 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:18.023935 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-754b4b8a-ca73-4fe6-9116-feaf8c837b43 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:18.024556 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-754b4b8a-ca73-4fe6-9116-feaf8c837b43 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:18.026063 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-a8908066-482a-480d-b9b0-3ceaa46e0b2c req-bc73091b-8639-4c1e-ad21-51566482b4e8 service nova] Creating event network-vif-deleted:f21d0899-8240-4786-a3d8-13e5ab18a6a5 for instance f21c35e4-2a21-41c4-91bb-e28a3a75fb35 on hv-cinder-84456 Jun 03 10:03:18.031208 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-754b4b8a-ca73-4fe6-9116-feaf8c837b43 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:18.031666 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-754b4b8a-ca73-4fe6-9116-feaf8c837b43 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:18.031792 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-a8908066-482a-480d-b9b0-3ceaa46e0b2c req-bc73091b-8639-4c1e-ad21-51566482b4e8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030356 Jun 03 10:03:18.032491 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 338/676] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:03:18.032611 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-754b4b8a-ca73-4fe6-9116-feaf8c837b43 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:18.032854 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-754b4b8a-ca73-4fe6-9116-feaf8c837b43 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:18.139698 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-6b9a33e3-cce8-4e99-83c1-3c7c386e5985 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:18.140833 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-6b9a33e3-cce8-4e99-83c1-3c7c386e5985 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: f21c35e4-2a21-41c4-91bb-e28a3a75fb35] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:18.149055 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6b9a33e3-cce8-4e99-83c1-3c7c386e5985 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:18.149630 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6b9a33e3-cce8-4e99-83c1-3c7c386e5985 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:18.155633 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6b9a33e3-cce8-4e99-83c1-3c7c386e5985 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:18.155633 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6b9a33e3-cce8-4e99-83c1-3c7c386e5985 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:18.392139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-6b9a33e3-cce8-4e99-83c1-3c7c386e5985 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82621df465a640b28eb955733ceda02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0f8d737269433bb6ce1baf51b8157b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:18.410216 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-6b9a33e3-cce8-4e99-83c1-3c7c386e5985 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35" status: 200 len: 1470 microversion: 2.1 time: 0.275413 Jun 03 10:03:18.419830 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 339/677] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:18 2022] GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35 => generated 1470 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:03:18.510215 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-754b4b8a-ca73-4fe6-9116-feaf8c837b43 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:18.519374 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-754b4b8a-ca73-4fe6-9116-feaf8c837b43 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f" status: 200 len: 1363 microversion: 2.1 time: 0.499256 Jun 03 10:03:18.519952 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 339/678] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:18 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f => generated 1363 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:03:19.427364 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-5be1fc62-d0a0-4713-a0f9-12cb22889464 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:19.427970 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-5be1fc62-d0a0-4713-a0f9-12cb22889464 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] [instance: f21c35e4-2a21-41c4-91bb-e28a3a75fb35] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:19.434679 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5be1fc62-d0a0-4713-a0f9-12cb22889464 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:19.435120 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5be1fc62-d0a0-4713-a0f9-12cb22889464 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:19.435872 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5be1fc62-d0a0-4713-a0f9-12cb22889464 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:19.436297 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5be1fc62-d0a0-4713-a0f9-12cb22889464 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:19.449458 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.wsgi [None req-5be1fc62-d0a0-4713-a0f9-12cb22889464 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] HTTP exception thrown: Instance f21c35e4-2a21-41c4-91bb-e28a3a75fb35 could not be found. Jun 03 10:03:19.451101 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-5be1fc62-d0a0-4713-a0f9-12cb22889464 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Request method failure captured: Jun 03 10:03:19.451101 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: request: GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35 HTTP/1.1 Jun 03 10:03:19.451101 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept: application/json Jun 03 10:03:19.451101 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept-Encoding: identity Jun 03 10:03:19.451101 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Connection: close Jun 03 10:03:19.451101 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Length: 0 Jun 03 10:03:19.451101 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Type: application/json Jun 03 10:03:19.451101 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Host: 10.222.0.42 Jun 03 10:03:19.451101 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Openstack-System-Scope: None Jun 03 10:03:19.451101 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: User-Agent: python-urllib3/1.26.9 Jun 03 10:03:19.451101 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Auth-Token: gAAAAABimdvSN6tTFxhhZ3m7xo_krfPkVg5RoM16R-LG76cABjpqpd8tmEAbWX8Z47fTMHbUjXKsXu9kB7BeTeJcbJvBjsrDMK1iDXgDjx50mEUZ4gFeAhV5wTBeUFdggVtt36m6wwWZvVj7GiNpkxTGXl0xqnqdGXF51vXVOI5h0ZQtBCklg9s Jun 03 10:03:19.451101 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Id: None Jun 03 10:03:19.451101 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Name: None Jun 03 10:03:19.451101 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Identity-Status: Confirmed Jun 03 10:03:19.451101 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Is-Admin-Project: True Jun 03 10:03:19.451101 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Id: default Jun 03 10:03:19.451101 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Name: Default Jun 03 10:03:19.451101 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Id: 6a0f8d737269433bb6ce1baf51b8157b Jun 03 10:03:19.451101 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Name: tempest-VolumesSnapshotTestJSON-959706326 Jun 03 10:03:19.451101 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Role: member,reader Jun 03 10:03:19.451101 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Roles: member,reader Jun 03 10:03:19.452716 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6a0f8d737269433bb6ce1baf51b8157b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6a0f8d737269433bb6ce1baf51b8157b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6a0f8d737269433bb6ce1baf51b8157b", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6a0f8d737269433bb6ce1baf51b8157b"}]}] Jun 03 10:03:19.452716 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant: tempest-VolumesSnapshotTestJSON-959706326 Jun 03 10:03:19.452716 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Id: 6a0f8d737269433bb6ce1baf51b8157b Jun 03 10:03:19.452716 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-959706326 Jun 03 10:03:19.452716 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User: tempest-VolumesSnapshotTestJSON-959706326-project Jun 03 10:03:19.452716 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Id: default Jun 03 10:03:19.452716 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Name: Default Jun 03 10:03:19.452716 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Id: 82621df465a640b28eb955733ceda02f Jun 03 10:03:19.452716 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Name: tempest-VolumesSnapshotTestJSON-959706326-project Jun 03 10:03:19.452716 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: method: > Jun 03 10:03:19.452716 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: exception: Instance f21c35e4-2a21-41c4-91bb-e28a3a75fb35 could not be found. Jun 03 10:03:19.452716 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: action_args: {'id': 'f21c35e4-2a21-41c4-91bb-e28a3a75fb35'} Jun 03 10:03:19.453580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:03:19.453580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:19.453580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:03:19.453580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:03:19.453580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:03:19.453580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:03:19.453580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:03:19.453580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:03:19.453580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:03:19.453580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:03:19.453580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f21c35e4-2a21-41c4-91bb-e28a3a75fb35 could not be found. Jun 03 10:03:19.453580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:03:19.453580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:19.453580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:03:19.453580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:19.453580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:19.453580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:19.453580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:03:19.453580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:03:19.453580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:03:19.455212 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:03:19.455212 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:03:19.455212 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:03:19.455212 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:03:19.455212 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:03:19.455212 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:03:19.455212 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:03:19.455212 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f21c35e4-2a21-41c4-91bb-e28a3a75fb35 could not be found. Jun 03 10:03:19.455212 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:03:19.455212 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:19.455212 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:03:19.455212 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:19.455212 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:19.455212 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:19.455212 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:03:19.455212 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:03:19.455212 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f21c35e4-2a21-41c4-91bb-e28a3a75fb35 could not be found. Jun 03 10:03:19.455212 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:03:19.456339 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-5be1fc62-d0a0-4713-a0f9-12cb22889464 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] Returning 404 to user: Instance f21c35e4-2a21-41c4-91bb-e28a3a75fb35 could not be found. {{(pid=125066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:03:19.456339 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-5be1fc62-d0a0-4713-a0f9-12cb22889464 tempest-VolumesSnapshotTestJSON-959706326 tempest-VolumesSnapshotTestJSON-959706326-project] 10.222.0.42 "GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35" status: 404 len: 111 microversion: 2.1 time: 0.029115 Jun 03 10:03:19.456339 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 340/679] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:19 2022] GET /compute/v2.1/servers/f21c35e4-2a21-41c4-91bb-e28a3a75fb35 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:03:19.536670 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-1a66839b-6aa1-45f5-9d57-5ec76d5a83a5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:19.537285 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-1a66839b-6aa1-45f5-9d57-5ec76d5a83a5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:19.543808 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1a66839b-6aa1-45f5-9d57-5ec76d5a83a5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:19.544262 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1a66839b-6aa1-45f5-9d57-5ec76d5a83a5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:19.545162 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1a66839b-6aa1-45f5-9d57-5ec76d5a83a5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:19.546252 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1a66839b-6aa1-45f5-9d57-5ec76d5a83a5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:19.687968 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-1a66839b-6aa1-45f5-9d57-5ec76d5a83a5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:19.695356 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-1a66839b-6aa1-45f5-9d57-5ec76d5a83a5 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f" status: 200 len: 1363 microversion: 2.1 time: 0.162660 Jun 03 10:03:19.695919 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 340/680] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:19 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:20.712511 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-b720585d-b193-42a0-bb7e-fb30c00cffcd tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:20.713108 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-b720585d-b193-42a0-bb7e-fb30c00cffcd tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:20.720305 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b720585d-b193-42a0-bb7e-fb30c00cffcd tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:20.720754 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b720585d-b193-42a0-bb7e-fb30c00cffcd tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:20.721520 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b720585d-b193-42a0-bb7e-fb30c00cffcd tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:20.721994 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b720585d-b193-42a0-bb7e-fb30c00cffcd tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:20.828945 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-96d8b2d9-7a2f-494d-a2e0-38b3feb9660f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:20.829516 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-96d8b2d9-7a2f-494d-a2e0-38b3feb9660f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:20.836092 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-96d8b2d9-7a2f-494d-a2e0-38b3feb9660f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:20.836536 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-96d8b2d9-7a2f-494d-a2e0-38b3feb9660f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:20.837286 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-96d8b2d9-7a2f-494d-a2e0-38b3feb9660f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:20.837717 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-96d8b2d9-7a2f-494d-a2e0-38b3feb9660f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:20.851116 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-b720585d-b193-42a0-bb7e-fb30c00cffcd tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:20.859423 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-b720585d-b193-42a0-bb7e-fb30c00cffcd tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f" status: 200 len: 1363 microversion: 2.1 time: 0.150814 Jun 03 10:03:20.860082 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 341/681] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:20 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:20.865070 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-96d8b2d9-7a2f-494d-a2e0-38b3feb9660f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Going to try to terminate instance {{(pid=125065) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:03:20.878784 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=100 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:21.171330 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-96d8b2d9-7a2f-494d-a2e0-38b3feb9660f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "DELETE /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 204 len: 0 microversion: 2.1 time: 0.345926 Jun 03 10:03:21.172001 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 341/682] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 3 10:03:20 2022] DELETE /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 03 10:03:21.179873 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-bf247239-d8c7-4b3a-9524-613bbadc36fd tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:21.180482 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-bf247239-d8c7-4b3a-9524-613bbadc36fd tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:21.186590 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bf247239-d8c7-4b3a-9524-613bbadc36fd tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:21.187044 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bf247239-d8c7-4b3a-9524-613bbadc36fd tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:21.187801 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bf247239-d8c7-4b3a-9524-613bbadc36fd tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:21.188239 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bf247239-d8c7-4b3a-9524-613bbadc36fd tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:21.317987 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-bf247239-d8c7-4b3a-9524-613bbadc36fd tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:21.325648 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-bf247239-d8c7-4b3a-9524-613bbadc36fd tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1505 microversion: 2.1 time: 0.149572 Jun 03 10:03:21.326803 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 342/683] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:21 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:21.877554 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-ce9ec7f5-d8c2-4d61-a7e3-cc2ff56feb6c tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:21.878300 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-ce9ec7f5-d8c2-4d61-a7e3-cc2ff56feb6c tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:21.885070 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ce9ec7f5-d8c2-4d61-a7e3-cc2ff56feb6c tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:21.885514 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ce9ec7f5-d8c2-4d61-a7e3-cc2ff56feb6c tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:21.886304 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ce9ec7f5-d8c2-4d61-a7e3-cc2ff56feb6c tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:21.886737 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ce9ec7f5-d8c2-4d61-a7e3-cc2ff56feb6c tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:22.022140 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-ce9ec7f5-d8c2-4d61-a7e3-cc2ff56feb6c tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:22.029496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-ce9ec7f5-d8c2-4d61-a7e3-cc2ff56feb6c tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f" status: 200 len: 1363 microversion: 2.1 time: 0.156767 Jun 03 10:03:22.030092 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 342/684] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:21 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:22.343685 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-6ebc6d2f-0af6-4bd8-b61f-cdd23217d5d7 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:22.344291 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-6ebc6d2f-0af6-4bd8-b61f-cdd23217d5d7 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:22.346702 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:22.351388 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6ebc6d2f-0af6-4bd8-b61f-cdd23217d5d7 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:22.351833 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6ebc6d2f-0af6-4bd8-b61f-cdd23217d5d7 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:22.352582 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6ebc6d2f-0af6-4bd8-b61f-cdd23217d5d7 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:22.353019 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6ebc6d2f-0af6-4bd8-b61f-cdd23217d5d7 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:22.486858 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-6ebc6d2f-0af6-4bd8-b61f-cdd23217d5d7 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:22.494287 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-6ebc6d2f-0af6-4bd8-b61f-cdd23217d5d7 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1505 microversion: 2.1 time: 0.154916 Jun 03 10:03:22.494848 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 343/685] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:22 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:23.046574 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-26b5cb96-5d4d-486a-990a-4df769e05b71 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:23.047202 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-26b5cb96-5d4d-486a-990a-4df769e05b71 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:23.053743 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-26b5cb96-5d4d-486a-990a-4df769e05b71 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:23.054243 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-26b5cb96-5d4d-486a-990a-4df769e05b71 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:23.055005 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-26b5cb96-5d4d-486a-990a-4df769e05b71 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:23.055445 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-26b5cb96-5d4d-486a-990a-4df769e05b71 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:23.185331 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-26b5cb96-5d4d-486a-990a-4df769e05b71 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:23.193332 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-26b5cb96-5d4d-486a-990a-4df769e05b71 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f" status: 200 len: 1363 microversion: 2.1 time: 0.150657 Jun 03 10:03:23.193918 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 343/686] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:23 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:23.511362 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-42d4ed90-ec5b-45cb-8d24-b5cedf0d7a99 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:23.511964 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-42d4ed90-ec5b-45cb-8d24-b5cedf0d7a99 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:23.519141 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-42d4ed90-ec5b-45cb-8d24-b5cedf0d7a99 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:23.519585 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-42d4ed90-ec5b-45cb-8d24-b5cedf0d7a99 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:23.520330 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-42d4ed90-ec5b-45cb-8d24-b5cedf0d7a99 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:23.520763 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-42d4ed90-ec5b-45cb-8d24-b5cedf0d7a99 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:23.646699 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-42d4ed90-ec5b-45cb-8d24-b5cedf0d7a99 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:23.654279 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-42d4ed90-ec5b-45cb-8d24-b5cedf0d7a99 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1505 microversion: 2.1 time: 0.146962 Jun 03 10:03:23.655379 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 344/687] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:23 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1505 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:24.210618 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-e927769f-726e-4c53-aabb-3a08a91039eb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:24.211221 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-e927769f-726e-4c53-aabb-3a08a91039eb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:24.217696 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e927769f-726e-4c53-aabb-3a08a91039eb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:24.218187 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e927769f-726e-4c53-aabb-3a08a91039eb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:24.218930 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e927769f-726e-4c53-aabb-3a08a91039eb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:24.219365 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e927769f-726e-4c53-aabb-3a08a91039eb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:24.346136 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-e927769f-726e-4c53-aabb-3a08a91039eb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:24.353410 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-e927769f-726e-4c53-aabb-3a08a91039eb tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f" status: 200 len: 1363 microversion: 2.1 time: 0.146676 Jun 03 10:03:24.353988 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 344/688] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:24 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:24.672419 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-a869da46-e936-4974-af1b-40a1c3eb906d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:24.673048 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-a869da46-e936-4974-af1b-40a1c3eb906d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:24.679827 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a869da46-e936-4974-af1b-40a1c3eb906d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:24.680270 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a869da46-e936-4974-af1b-40a1c3eb906d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:24.681015 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a869da46-e936-4974-af1b-40a1c3eb906d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:24.681444 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a869da46-e936-4974-af1b-40a1c3eb906d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:24.815038 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-a869da46-e936-4974-af1b-40a1c3eb906d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:24.822601 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-a869da46-e936-4974-af1b-40a1c3eb906d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1505 microversion: 2.1 time: 0.154760 Jun 03 10:03:24.823161 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 345/689] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:24 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:25.006327 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-a40c5224-a252-4b08-908e-ee4043d8482a req-c242c50c-346d-49e0-87b1-f86df9a0cea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbff6766-51d9-41a5-b9f9-bdb117cad35f", "name": "network-vif-plugged", "status": "completed", "tag": "13121560-48ad-4ce7-91f1-cace26c579e9"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:25.024329 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-a40c5224-a252-4b08-908e-ee4043d8482a req-c242c50c-346d-49e0-87b1-f86df9a0cea7 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:25.024329 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-a40c5224-a252-4b08-908e-ee4043d8482a req-c242c50c-346d-49e0-87b1-f86df9a0cea7 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:25.028199 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-a40c5224-a252-4b08-908e-ee4043d8482a req-c242c50c-346d-49e0-87b1-f86df9a0cea7 service nova] Creating event network-vif-plugged:13121560-48ad-4ce7-91f1-cace26c579e9 for instance cbff6766-51d9-41a5-b9f9-bdb117cad35f on hv-cinder-84456 Jun 03 10:03:25.033751 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-a40c5224-a252-4b08-908e-ee4043d8482a req-c242c50c-346d-49e0-87b1-f86df9a0cea7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031815 Jun 03 10:03:25.034592 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 345/690] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:03:25.370328 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-79589985-b157-47a5-90e1-06a316cd865c tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:25.370943 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-79589985-b157-47a5-90e1-06a316cd865c tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:25.377451 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-79589985-b157-47a5-90e1-06a316cd865c tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:25.377934 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-79589985-b157-47a5-90e1-06a316cd865c tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:25.378707 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-79589985-b157-47a5-90e1-06a316cd865c tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:25.379151 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-79589985-b157-47a5-90e1-06a316cd865c tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:25.601997 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-43f9a7ad-4a81-4281-8d5e-1a69947b31a5 req-f5b2cb8a-edf0-4316-8de6-388dc790c9da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "268a2ebf-7c18-40e4-85fb-edf05a174e1d", "name": "network-vif-deleted", "tag": "bdc90016-2ff6-4553-a6ad-1bfc7f7efb08"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:25.611927 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-43f9a7ad-4a81-4281-8d5e-1a69947b31a5 req-f5b2cb8a-edf0-4316-8de6-388dc790c9da service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:25.612594 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-43f9a7ad-4a81-4281-8d5e-1a69947b31a5 req-f5b2cb8a-edf0-4316-8de6-388dc790c9da service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:25.624731 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-43f9a7ad-4a81-4281-8d5e-1a69947b31a5 req-f5b2cb8a-edf0-4316-8de6-388dc790c9da service nova] Creating event network-vif-deleted:bdc90016-2ff6-4553-a6ad-1bfc7f7efb08 for instance 268a2ebf-7c18-40e4-85fb-edf05a174e1d on hv-cinder-84456 Jun 03 10:03:25.629611 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-43f9a7ad-4a81-4281-8d5e-1a69947b31a5 req-f5b2cb8a-edf0-4316-8de6-388dc790c9da service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031555 Jun 03 10:03:25.630439 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 346/691] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:03:25.688908 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-79589985-b157-47a5-90e1-06a316cd865c tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:25.696663 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-79589985-b157-47a5-90e1-06a316cd865c tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f" status: 200 len: 1363 microversion: 2.1 time: 0.330389 Jun 03 10:03:25.697231 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 346/692] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:25 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f => generated 1363 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:25.840532 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-d5f48d15-4799-4d17-8d44-3268acd3d21f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:25.841255 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-d5f48d15-4799-4d17-8d44-3268acd3d21f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:25.848288 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d5f48d15-4799-4d17-8d44-3268acd3d21f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:25.848893 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d5f48d15-4799-4d17-8d44-3268acd3d21f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:25.851936 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d5f48d15-4799-4d17-8d44-3268acd3d21f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:25.851936 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d5f48d15-4799-4d17-8d44-3268acd3d21f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:25.923880 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-d5f48d15-4799-4d17-8d44-3268acd3d21f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:25.931656 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-d5f48d15-4799-4d17-8d44-3268acd3d21f tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1292 microversion: 2.1 time: 0.095458 Jun 03 10:03:25.941240 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 347/693] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:25 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1292 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:26.713256 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-25cfc23b-100d-4f1c-a4a1-3242761626fe tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:26.713792 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-25cfc23b-100d-4f1c-a4a1-3242761626fe tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:26.720916 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-25cfc23b-100d-4f1c-a4a1-3242761626fe tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:26.721368 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-25cfc23b-100d-4f1c-a4a1-3242761626fe tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:26.722159 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-25cfc23b-100d-4f1c-a4a1-3242761626fe tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:26.722603 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-25cfc23b-100d-4f1c-a4a1-3242761626fe tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:26.900967 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-25cfc23b-100d-4f1c-a4a1-3242761626fe tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:26.909574 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-25cfc23b-100d-4f1c-a4a1-3242761626fe tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f" status: 200 len: 1363 microversion: 2.1 time: 0.200257 Jun 03 10:03:26.910175 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 347/694] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:26 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:26.948423 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-597d731f-71e0-4b60-8591-2aa0bf83e10b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:26.949036 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-597d731f-71e0-4b60-8591-2aa0bf83e10b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:26.956740 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-597d731f-71e0-4b60-8591-2aa0bf83e10b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:26.957160 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-597d731f-71e0-4b60-8591-2aa0bf83e10b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:26.957954 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-597d731f-71e0-4b60-8591-2aa0bf83e10b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:26.958396 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-597d731f-71e0-4b60-8591-2aa0bf83e10b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:26.990999 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-597d731f-71e0-4b60-8591-2aa0bf83e10b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:26.991360 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-597d731f-71e0-4b60-8591-2aa0bf83e10b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:26.991802 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.objects.instance [None req-597d731f-71e0-4b60-8591-2aa0bf83e10b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lazy-loading 'fault' on Instance uuid 268a2ebf-7c18-40e4-85fb-edf05a174e1d {{(pid=125065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:03:27.032756 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-597d731f-71e0-4b60-8591-2aa0bf83e10b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:27.040198 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-597d731f-71e0-4b60-8591-2aa0bf83e10b tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 200 len: 1311 microversion: 2.1 time: 0.095636 Jun 03 10:03:27.040767 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 348/695] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:26 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:27.926364 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-ec9b3202-46d5-4797-aa51-51516fae630a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:27.926976 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-ec9b3202-46d5-4797-aa51-51516fae630a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:27.933401 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ec9b3202-46d5-4797-aa51-51516fae630a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:27.933851 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ec9b3202-46d5-4797-aa51-51516fae630a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:27.934636 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ec9b3202-46d5-4797-aa51-51516fae630a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:27.935071 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ec9b3202-46d5-4797-aa51-51516fae630a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:28.056573 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-09085d09-ea2d-48ad-80dc-95a10ab4c29a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:28.057177 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-09085d09-ea2d-48ad-80dc-95a10ab4c29a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 268a2ebf-7c18-40e4-85fb-edf05a174e1d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:28.063717 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-09085d09-ea2d-48ad-80dc-95a10ab4c29a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:28.064349 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-09085d09-ea2d-48ad-80dc-95a10ab4c29a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:28.064921 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-09085d09-ea2d-48ad-80dc-95a10ab4c29a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:28.065354 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-09085d09-ea2d-48ad-80dc-95a10ab4c29a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:28.068786 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-ec9b3202-46d5-4797-aa51-51516fae630a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:28.077205 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-ec9b3202-46d5-4797-aa51-51516fae630a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f" status: 200 len: 1549 microversion: 2.1 time: 0.154632 Jun 03 10:03:28.078630 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 348/696] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:27 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:28.081236 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.wsgi [None req-09085d09-ea2d-48ad-80dc-95a10ab4c29a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] HTTP exception thrown: Instance 268a2ebf-7c18-40e4-85fb-edf05a174e1d could not be found. Jun 03 10:03:28.082927 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-09085d09-ea2d-48ad-80dc-95a10ab4c29a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Request method failure captured: Jun 03 10:03:28.082927 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: request: GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d HTTP/1.1 Jun 03 10:03:28.082927 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept: application/json Jun 03 10:03:28.082927 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept-Encoding: identity Jun 03 10:03:28.082927 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Connection: close Jun 03 10:03:28.082927 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Length: 0 Jun 03 10:03:28.082927 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Type: application/json Jun 03 10:03:28.082927 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Host: 10.222.0.42 Jun 03 10:03:28.082927 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Openstack-System-Scope: None Jun 03 10:03:28.082927 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: User-Agent: python-urllib3/1.26.9 Jun 03 10:03:28.082927 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Auth-Token: gAAAAABimds_lF-taAYQo6OqoH0o0qi_k4NNuMaAcWJ32OQUNw2FlKeLvYNXSQEH9BN_rrTQvUY_gre2GoIt-GajpX5LOw35Rcbqj_XeR_tQGE2UjgXtf1IV-n56Dfe8ZzhxcJSCI1WvNiH6DeAg_ruh1xJPuTtCWLGR6KAI-13SXw4-Q7nABOE Jun 03 10:03:28.082927 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Id: None Jun 03 10:03:28.082927 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Name: None Jun 03 10:03:28.082927 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Identity-Status: Confirmed Jun 03 10:03:28.082927 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Is-Admin-Project: True Jun 03 10:03:28.082927 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Id: default Jun 03 10:03:28.082927 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Name: Default Jun 03 10:03:28.082927 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Id: 071b399988474af1a1c709aac97c1744 Jun 03 10:03:28.082927 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1884263324 Jun 03 10:03:28.082927 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Role: member,reader Jun 03 10:03:28.082927 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Roles: member,reader Jun 03 10:03:28.084440 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/071b399988474af1a1c709aac97c1744"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/071b399988474af1a1c709aac97c1744"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_071b399988474af1a1c709aac97c1744", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/071b399988474af1a1c709aac97c1744"}]}] Jun 03 10:03:28.084440 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1884263324 Jun 03 10:03:28.084440 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Id: 071b399988474af1a1c709aac97c1744 Jun 03 10:03:28.084440 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1884263324 Jun 03 10:03:28.084440 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User: tempest-ServerRescueNegativeTestJSON-1884263324-project Jun 03 10:03:28.084440 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Id: default Jun 03 10:03:28.084440 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Name: Default Jun 03 10:03:28.084440 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Id: 6113d715500240098217caf641db763a Jun 03 10:03:28.084440 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1884263324-project Jun 03 10:03:28.084440 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: method: > Jun 03 10:03:28.084440 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: exception: Instance 268a2ebf-7c18-40e4-85fb-edf05a174e1d could not be found. Jun 03 10:03:28.084440 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: action_args: {'id': '268a2ebf-7c18-40e4-85fb-edf05a174e1d'} Jun 03 10:03:28.085335 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:03:28.085335 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:28.085335 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:03:28.085335 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:03:28.085335 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:03:28.085335 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:03:28.085335 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:03:28.085335 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:03:28.085335 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:03:28.085335 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:03:28.085335 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 268a2ebf-7c18-40e4-85fb-edf05a174e1d could not be found. Jun 03 10:03:28.085335 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:03:28.085335 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:28.085335 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:03:28.085335 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:28.085335 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:28.085335 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:28.085335 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:03:28.085335 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:03:28.085335 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:03:28.086670 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:03:28.086670 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:03:28.086670 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:03:28.086670 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:03:28.086670 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:03:28.086670 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:03:28.086670 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:03:28.086670 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 268a2ebf-7c18-40e4-85fb-edf05a174e1d could not be found. Jun 03 10:03:28.086670 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:03:28.086670 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:28.086670 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:03:28.086670 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:28.086670 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:28.086670 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:28.086670 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:03:28.086670 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:03:28.086670 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 268a2ebf-7c18-40e4-85fb-edf05a174e1d could not be found. Jun 03 10:03:28.086670 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:03:28.087818 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-09085d09-ea2d-48ad-80dc-95a10ab4c29a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Returning 404 to user: Instance 268a2ebf-7c18-40e4-85fb-edf05a174e1d could not be found. {{(pid=125065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:03:28.087818 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-09085d09-ea2d-48ad-80dc-95a10ab4c29a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d" status: 404 len: 111 microversion: 2.1 time: 0.031649 Jun 03 10:03:28.087818 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 349/697] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:28 2022] GET /compute/v2.1/servers/268a2ebf-7c18-40e4-85fb-edf05a174e1d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 10:03:28.094350 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-7335b645-3eff-44f8-9584-c093464e872a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:28.094721 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-8b7c6fc7-6b6d-4f78-b0b3-0b50c7f284b9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:28.094851 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-7335b645-3eff-44f8-9584-c093464e872a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:28.095224 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-8b7c6fc7-6b6d-4f78-b0b3-0b50c7f284b9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:28.100972 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7335b645-3eff-44f8-9584-c093464e872a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:28.101396 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8b7c6fc7-6b6d-4f78-b0b3-0b50c7f284b9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:28.101522 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7335b645-3eff-44f8-9584-c093464e872a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:28.101844 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8b7c6fc7-6b6d-4f78-b0b3-0b50c7f284b9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:28.102240 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7335b645-3eff-44f8-9584-c093464e872a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:28.102638 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8b7c6fc7-6b6d-4f78-b0b3-0b50c7f284b9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:28.102736 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7335b645-3eff-44f8-9584-c093464e872a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:28.103074 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8b7c6fc7-6b6d-4f78-b0b3-0b50c7f284b9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:28.130207 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-8b7c6fc7-6b6d-4f78-b0b3-0b50c7f284b9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Going to try to terminate instance {{(pid=125066) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:03:28.179985 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-7335b645-3eff-44f8-9584-c093464e872a tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089732 Jun 03 10:03:28.180575 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 350/698] 10.222.0.42 () {58 vars in 1274 bytes} [Fri Jun 3 10:03:28 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:03:28.456190 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-8b7c6fc7-6b6d-4f78-b0b3-0b50c7f284b9 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "DELETE /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 204 len: 0 microversion: 2.1 time: 0.365728 Jun 03 10:03:28.456821 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 349/699] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 3 10:03:28 2022] DELETE /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:03:28.466060 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-3c582c9c-3105-43c1-a293-27dc40cbe17a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:28.466928 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-3c582c9c-3105-43c1-a293-27dc40cbe17a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:28.469425 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:28.474268 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3c582c9c-3105-43c1-a293-27dc40cbe17a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:28.474715 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3c582c9c-3105-43c1-a293-27dc40cbe17a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:28.475482 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3c582c9c-3105-43c1-a293-27dc40cbe17a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:28.475921 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3c582c9c-3105-43c1-a293-27dc40cbe17a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:28.715030 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-3c582c9c-3105-43c1-a293-27dc40cbe17a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:28.724729 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-3c582c9c-3105-43c1-a293-27dc40cbe17a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 200 len: 1520 microversion: 2.1 time: 0.263433 Jun 03 10:03:28.725539 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 351/700] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:28 2022] GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:29.251378 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-ed5a70e4-fcf7-445f-ae33-ed1293ffcdae req-4fc0f96c-08fa-4fe3-8969-a8e9e31788d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbff6766-51d9-41a5-b9f9-bdb117cad35f", "tag": "13121560-48ad-4ce7-91f1-cace26c579e9"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:29.259850 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-ed5a70e4-fcf7-445f-ae33-ed1293ffcdae req-4fc0f96c-08fa-4fe3-8969-a8e9e31788d8 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:29.260290 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-ed5a70e4-fcf7-445f-ae33-ed1293ffcdae req-4fc0f96c-08fa-4fe3-8969-a8e9e31788d8 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:29.271521 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-ed5a70e4-fcf7-445f-ae33-ed1293ffcdae req-4fc0f96c-08fa-4fe3-8969-a8e9e31788d8 service nova] Creating event network-changed:13121560-48ad-4ce7-91f1-cace26c579e9 for instance cbff6766-51d9-41a5-b9f9-bdb117cad35f on hv-cinder-84456 Jun 03 10:03:29.276260 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-ed5a70e4-fcf7-445f-ae33-ed1293ffcdae req-4fc0f96c-08fa-4fe3-8969-a8e9e31788d8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028884 Jun 03 10:03:29.276846 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 350/701] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:03:29.741847 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-da2b8fbf-d2eb-4e84-b27f-1dfa1ff082aa tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:29.742624 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-da2b8fbf-d2eb-4e84-b27f-1dfa1ff082aa tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:29.751034 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-da2b8fbf-d2eb-4e84-b27f-1dfa1ff082aa tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:29.751657 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-da2b8fbf-d2eb-4e84-b27f-1dfa1ff082aa tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:29.752657 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-da2b8fbf-d2eb-4e84-b27f-1dfa1ff082aa tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:29.753095 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-da2b8fbf-d2eb-4e84-b27f-1dfa1ff082aa tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:29.884626 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-da2b8fbf-d2eb-4e84-b27f-1dfa1ff082aa tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:29.892701 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-da2b8fbf-d2eb-4e84-b27f-1dfa1ff082aa tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 200 len: 1520 microversion: 2.1 time: 0.154841 Jun 03 10:03:29.893265 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 352/702] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:29 2022] GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:30.910195 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-7343af5d-500e-4160-83cd-8f491915f95d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:30.910813 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-7343af5d-500e-4160-83cd-8f491915f95d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:30.917229 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7343af5d-500e-4160-83cd-8f491915f95d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:30.917671 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7343af5d-500e-4160-83cd-8f491915f95d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:30.918485 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7343af5d-500e-4160-83cd-8f491915f95d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:30.918932 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7343af5d-500e-4160-83cd-8f491915f95d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:31.047807 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-7343af5d-500e-4160-83cd-8f491915f95d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:31.055159 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-7343af5d-500e-4160-83cd-8f491915f95d tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 200 len: 1520 microversion: 2.1 time: 0.150353 Jun 03 10:03:31.055724 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 351/703] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:30 2022] GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:32.072098 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-85c7c74a-8d6e-4d01-ad1e-a8030d977b0a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:32.072708 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-85c7c74a-8d6e-4d01-ad1e-a8030d977b0a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:32.079281 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-85c7c74a-8d6e-4d01-ad1e-a8030d977b0a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:32.079735 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-85c7c74a-8d6e-4d01-ad1e-a8030d977b0a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:32.080493 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-85c7c74a-8d6e-4d01-ad1e-a8030d977b0a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:32.080926 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-85c7c74a-8d6e-4d01-ad1e-a8030d977b0a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:32.204372 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-85c7c74a-8d6e-4d01-ad1e-a8030d977b0a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:32.211865 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-85c7c74a-8d6e-4d01-ad1e-a8030d977b0a tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 200 len: 1520 microversion: 2.1 time: 0.143888 Jun 03 10:03:32.212467 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 353/704] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:32 2022] GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 1520 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:33.228688 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-0fbe2d6f-aa69-4f93-8806-5655ff3812ce tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:33.229350 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-0fbe2d6f-aa69-4f93-8806-5655ff3812ce tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:33.236323 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0fbe2d6f-aa69-4f93-8806-5655ff3812ce tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:33.236764 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0fbe2d6f-aa69-4f93-8806-5655ff3812ce tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:33.237512 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0fbe2d6f-aa69-4f93-8806-5655ff3812ce tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:33.237970 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0fbe2d6f-aa69-4f93-8806-5655ff3812ce tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:33.365862 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-0fbe2d6f-aa69-4f93-8806-5655ff3812ce tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:33.373171 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-0fbe2d6f-aa69-4f93-8806-5655ff3812ce tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 200 len: 1520 microversion: 2.1 time: 0.148409 Jun 03 10:03:33.373737 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 352/705] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:33 2022] GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:34.390346 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-665052ba-5ab5-46c7-a369-da013fecbbf2 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:34.390970 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-665052ba-5ab5-46c7-a369-da013fecbbf2 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:34.398154 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-665052ba-5ab5-46c7-a369-da013fecbbf2 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:34.398600 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-665052ba-5ab5-46c7-a369-da013fecbbf2 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:34.399349 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-665052ba-5ab5-46c7-a369-da013fecbbf2 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:34.399777 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-665052ba-5ab5-46c7-a369-da013fecbbf2 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:34.700873 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-665052ba-5ab5-46c7-a369-da013fecbbf2 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:34.708327 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-665052ba-5ab5-46c7-a369-da013fecbbf2 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 200 len: 1520 microversion: 2.1 time: 0.321816 Jun 03 10:03:34.708899 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 354/706] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:34 2022] GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 1520 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:35.059369 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-4520daed-72a2-4bc6-b39a-99557eae3ce2 req-1c850ba4-7078-4bb9-bbcf-ea0b78edaca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28ff128f-ff5e-4889-9f83-bdfb4b86a83d", "name": "network-vif-deleted", "tag": "d8e80358-de18-46e9-b759-6c8d92fd7f83"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:35.068288 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-4520daed-72a2-4bc6-b39a-99557eae3ce2 req-1c850ba4-7078-4bb9-bbcf-ea0b78edaca8 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:35.068738 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-4520daed-72a2-4bc6-b39a-99557eae3ce2 req-1c850ba4-7078-4bb9-bbcf-ea0b78edaca8 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:35.080041 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-4520daed-72a2-4bc6-b39a-99557eae3ce2 req-1c850ba4-7078-4bb9-bbcf-ea0b78edaca8 service nova] Creating event network-vif-deleted:d8e80358-de18-46e9-b759-6c8d92fd7f83 for instance 28ff128f-ff5e-4889-9f83-bdfb4b86a83d on hv-cinder-84456 Jun 03 10:03:35.084981 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-4520daed-72a2-4bc6-b39a-99557eae3ce2 req-1c850ba4-7078-4bb9-bbcf-ea0b78edaca8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093614 Jun 03 10:03:35.085634 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 353/707] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:03:35.724781 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-d97a3131-957c-49df-ba2c-3df88515a39e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:35.725458 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-d97a3131-957c-49df-ba2c-3df88515a39e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:35.732006 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d97a3131-957c-49df-ba2c-3df88515a39e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:35.732453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d97a3131-957c-49df-ba2c-3df88515a39e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:35.733209 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d97a3131-957c-49df-ba2c-3df88515a39e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:35.733691 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d97a3131-957c-49df-ba2c-3df88515a39e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:35.764594 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d97a3131-957c-49df-ba2c-3df88515a39e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:35.765038 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d97a3131-957c-49df-ba2c-3df88515a39e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:35.765486 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.objects.instance [None req-d97a3131-957c-49df-ba2c-3df88515a39e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lazy-loading 'fault' on Instance uuid 28ff128f-ff5e-4889-9f83-bdfb4b86a83d {{(pid=125065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:03:35.805634 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-d97a3131-957c-49df-ba2c-3df88515a39e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6113d715500240098217caf641db763a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071b399988474af1a1c709aac97c1744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:35.819094 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-d97a3131-957c-49df-ba2c-3df88515a39e tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 200 len: 1311 microversion: 2.1 time: 0.098162 Jun 03 10:03:35.819678 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 355/708] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:35 2022] GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:36.837337 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-a6016751-a91f-407b-8ccb-ea3457d3c951 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:36.838088 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-a6016751-a91f-407b-8ccb-ea3457d3c951 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] [instance: 28ff128f-ff5e-4889-9f83-bdfb4b86a83d] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:36.844221 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a6016751-a91f-407b-8ccb-ea3457d3c951 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:36.844670 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a6016751-a91f-407b-8ccb-ea3457d3c951 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:36.845429 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a6016751-a91f-407b-8ccb-ea3457d3c951 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:36.845863 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a6016751-a91f-407b-8ccb-ea3457d3c951 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:36.858916 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.wsgi [None req-a6016751-a91f-407b-8ccb-ea3457d3c951 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] HTTP exception thrown: Instance 28ff128f-ff5e-4889-9f83-bdfb4b86a83d could not be found. Jun 03 10:03:36.860533 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-a6016751-a91f-407b-8ccb-ea3457d3c951 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Request method failure captured: Jun 03 10:03:36.860533 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: request: GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d HTTP/1.1 Jun 03 10:03:36.860533 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept: application/json Jun 03 10:03:36.860533 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept-Encoding: identity Jun 03 10:03:36.860533 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Connection: close Jun 03 10:03:36.860533 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Length: 0 Jun 03 10:03:36.860533 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Type: application/json Jun 03 10:03:36.860533 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Host: 10.222.0.42 Jun 03 10:03:36.860533 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Openstack-System-Scope: None Jun 03 10:03:36.860533 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: User-Agent: python-urllib3/1.26.9 Jun 03 10:03:36.860533 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Auth-Token: gAAAAABimds_lF-taAYQo6OqoH0o0qi_k4NNuMaAcWJ32OQUNw2FlKeLvYNXSQEH9BN_rrTQvUY_gre2GoIt-GajpX5LOw35Rcbqj_XeR_tQGE2UjgXtf1IV-n56Dfe8ZzhxcJSCI1WvNiH6DeAg_ruh1xJPuTtCWLGR6KAI-13SXw4-Q7nABOE Jun 03 10:03:36.860533 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Id: None Jun 03 10:03:36.860533 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Name: None Jun 03 10:03:36.860533 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Identity-Status: Confirmed Jun 03 10:03:36.860533 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Is-Admin-Project: True Jun 03 10:03:36.860533 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Id: default Jun 03 10:03:36.860533 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Name: Default Jun 03 10:03:36.860533 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Id: 071b399988474af1a1c709aac97c1744 Jun 03 10:03:36.860533 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1884263324 Jun 03 10:03:36.860533 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Role: member,reader Jun 03 10:03:36.860533 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Roles: member,reader Jun 03 10:03:36.862662 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/071b399988474af1a1c709aac97c1744"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/071b399988474af1a1c709aac97c1744"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_071b399988474af1a1c709aac97c1744", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/071b399988474af1a1c709aac97c1744"}]}] Jun 03 10:03:36.862662 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1884263324 Jun 03 10:03:36.862662 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Id: 071b399988474af1a1c709aac97c1744 Jun 03 10:03:36.862662 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1884263324 Jun 03 10:03:36.862662 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User: tempest-ServerRescueNegativeTestJSON-1884263324-project Jun 03 10:03:36.862662 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Id: default Jun 03 10:03:36.862662 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Name: Default Jun 03 10:03:36.862662 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Id: 6113d715500240098217caf641db763a Jun 03 10:03:36.862662 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1884263324-project Jun 03 10:03:36.862662 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: method: > Jun 03 10:03:36.862662 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: exception: Instance 28ff128f-ff5e-4889-9f83-bdfb4b86a83d could not be found. Jun 03 10:03:36.862662 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: action_args: {'id': '28ff128f-ff5e-4889-9f83-bdfb4b86a83d'} Jun 03 10:03:36.863693 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:03:36.863693 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:36.863693 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:03:36.863693 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:03:36.863693 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:03:36.863693 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:03:36.863693 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:03:36.863693 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:03:36.863693 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:03:36.863693 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:03:36.863693 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28ff128f-ff5e-4889-9f83-bdfb4b86a83d could not be found. Jun 03 10:03:36.863693 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:03:36.863693 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:36.863693 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:03:36.863693 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:36.863693 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:36.863693 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:36.863693 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:03:36.863693 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:03:36.863693 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:03:36.865177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:03:36.865177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:03:36.865177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:03:36.865177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:03:36.865177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:03:36.865177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:03:36.865177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:03:36.865177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28ff128f-ff5e-4889-9f83-bdfb4b86a83d could not be found. Jun 03 10:03:36.865177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:03:36.865177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:36.865177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:03:36.865177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:36.865177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:36.865177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:36.865177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:03:36.865177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:03:36.865177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28ff128f-ff5e-4889-9f83-bdfb4b86a83d could not be found. Jun 03 10:03:36.865177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:03:36.866595 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-a6016751-a91f-407b-8ccb-ea3457d3c951 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] Returning 404 to user: Instance 28ff128f-ff5e-4889-9f83-bdfb4b86a83d could not be found. {{(pid=125066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:03:36.866595 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-a6016751-a91f-407b-8ccb-ea3457d3c951 tempest-ServerRescueNegativeTestJSON-1884263324 tempest-ServerRescueNegativeTestJSON-1884263324-project] 10.222.0.42 "GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d" status: 404 len: 111 microversion: 2.1 time: 0.030064 Jun 03 10:03:36.866595 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 354/709] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:36 2022] GET /compute/v2.1/servers/28ff128f-ff5e-4889-9f83-bdfb4b86a83d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:03:46.009229 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_api:SELECT=11 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:46.009229 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:46.266080 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-b661a400-102a-4e00-a5f1-adf41e93daed tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:46.266797 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-b661a400-102a-4e00-a5f1-adf41e93daed tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:46.275595 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b661a400-102a-4e00-a5f1-adf41e93daed tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:46.277566 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b661a400-102a-4e00-a5f1-adf41e93daed tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:46.277566 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b661a400-102a-4e00-a5f1-adf41e93daed tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:46.277773 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b661a400-102a-4e00-a5f1-adf41e93daed tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:46.308379 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-b661a400-102a-4e00-a5f1-adf41e93daed tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc/ips" status: 200 len: 152 microversion: 2.20 time: 0.308375 Jun 03 10:03:46.309124 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 356/710] 10.222.0.42 () {60 vars in 1288 bytes} [Fri Jun 3 10:03:45 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc/ips => generated 152 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 10:03:48.519785 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:48.520744 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:48.574871 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-8fb855a2-7d9a-4fb1-9180-6f4e3f7621ab tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:48.574871 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-8fb855a2-7d9a-4fb1-9180-6f4e3f7621ab tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:48.582428 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8fb855a2-7d9a-4fb1-9180-6f4e3f7621ab tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:48.583422 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8fb855a2-7d9a-4fb1-9180-6f4e3f7621ab tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:48.584438 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8fb855a2-7d9a-4fb1-9180-6f4e3f7621ab tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:48.585091 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8fb855a2-7d9a-4fb1-9180-6f4e3f7621ab tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:48.609234 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.objects.instance [None req-8fb855a2-7d9a-4fb1-9180-6f4e3f7621ab tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lazy-loading 'flavor' on Instance uuid a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc {{(pid=125065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:03:48.644250 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-f52f4e9b-537b-4f27-85f2-69b06c4e6f7f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Action: 'create', calling method: .version_select at 0x7f8d23df20d0>, body: {"keypair": {"name": "tempest-keypair-479088882", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKn2q6qaQeJtBjql3LAKjBU581+TAwb7YMHADNuGY1p7LmyUh+QUoBtynzUq8nwbegmORgKltUrm9O75YUsEEOvLFl12X/N8nbW60CmXcYUhNoRkcBjsfCho3wUopiFRWw=="}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:48.659821 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-f52f4e9b-537b-4f27-85f2-69b06c4e6f7f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Getting quotas for project 3e51010dd5d84daf8aa43859e9e7cb6d. Resources: {'key_pairs'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:03:48.663777 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-f52f4e9b-537b-4f27-85f2-69b06c4e6f7f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Getting quotas for user ce77221a2c8d4c4395bed092c1967b28 and project 3e51010dd5d84daf8aa43859e9e7cb6d. Resources: {'key_pairs'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:03:48.738443 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-f52f4e9b-537b-4f27-85f2-69b06c4e6f7f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.224709 Jun 03 10:03:48.739052 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 355/711] 10.222.0.42 () {60 vars in 1158 bytes} [Fri Jun 3 10:03:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:03:49.107140 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-8fb855a2-7d9a-4fb1-9180-6f4e3f7621ab tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "POST /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc/action" status: 202 len: 0 microversion: 2.20 time: 0.538626 Jun 03 10:03:49.108567 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 357/712] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jun 3 10:03:48 2022] POST /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc/action => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 03 10:03:49.116832 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-32c1ba22-e0a3-44bb-800f-8749ab345bae tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:49.117451 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-32c1ba22-e0a3-44bb-800f-8749ab345bae tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:49.124358 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-32c1ba22-e0a3-44bb-800f-8749ab345bae tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:49.124805 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-32c1ba22-e0a3-44bb-800f-8749ab345bae tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:49.125768 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-32c1ba22-e0a3-44bb-800f-8749ab345bae tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:49.126234 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-32c1ba22-e0a3-44bb-800f-8749ab345bae tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:49.267115 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-32c1ba22-e0a3-44bb-800f-8749ab345bae tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:49.275118 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-32c1ba22-e0a3-44bb-800f-8749ab345bae tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:49.277612 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-32c1ba22-e0a3-44bb-800f-8749ab345bae tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:49.277969 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-32c1ba22-e0a3-44bb-800f-8749ab345bae tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1725 microversion: 2.20 time: 0.165241 Jun 03 10:03:49.279009 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 356/713] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:03:49 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:03:50.302458 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-3e78679c-038d-4d87-bb25-c6d664da5c41 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:50.303164 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-3e78679c-038d-4d87-bb25-c6d664da5c41 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:50.309744 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3e78679c-038d-4d87-bb25-c6d664da5c41 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:50.310392 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3e78679c-038d-4d87-bb25-c6d664da5c41 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:50.311407 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3e78679c-038d-4d87-bb25-c6d664da5c41 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:50.311903 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3e78679c-038d-4d87-bb25-c6d664da5c41 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:50.512065 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-3e78679c-038d-4d87-bb25-c6d664da5c41 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:50.521793 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-3e78679c-038d-4d87-bb25-c6d664da5c41 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:50.528371 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-3e78679c-038d-4d87-bb25-c6d664da5c41 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:50.528371 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-3e78679c-038d-4d87-bb25-c6d664da5c41 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1725 microversion: 2.20 time: 0.228451 Jun 03 10:03:50.528371 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 358/714] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:03:50 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1725 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:03:51.231892 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-6a009991-b9f2-4aaf-89e2-6f8ae8a29633 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-472265260", "imageRef": "0d2dd03b-4531-46f3-88da-0380e97b1bd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "284be7b5-7c4f-4f54-b772-bb0f4e7cb533"}], "security_groups": [{"name": "tempest-securitygroup--1062355970"}], "key_name": "tempest-keypair-479088882", "user_data": "}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:51.354878 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.network.neutron [None req-6a009991-b9f2-4aaf-89e2-6f8ae8a29633 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] validate_networks() for [('284be7b5-7c4f-4f54-b772-bb0f4e7cb533', None, None, None, None, None)] {{(pid=125066) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 10:03:51.549382 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-2bb33c5a-9dcb-4929-9ea5-f1e75ffc84ff tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:51.550688 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-2bb33c5a-9dcb-4929-9ea5-f1e75ffc84ff tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:51.558674 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2bb33c5a-9dcb-4929-9ea5-f1e75ffc84ff tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:51.559489 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2bb33c5a-9dcb-4929-9ea5-f1e75ffc84ff tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:51.560909 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2bb33c5a-9dcb-4929-9ea5-f1e75ffc84ff tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:51.561583 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2bb33c5a-9dcb-4929-9ea5-f1e75ffc84ff tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:51.736658 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-2bb33c5a-9dcb-4929-9ea5-f1e75ffc84ff tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:51.745748 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-2bb33c5a-9dcb-4929-9ea5-f1e75ffc84ff tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:51.747392 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-2bb33c5a-9dcb-4929-9ea5-f1e75ffc84ff tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:51.754353 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-2bb33c5a-9dcb-4929-9ea5-f1e75ffc84ff tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1725 microversion: 2.20 time: 0.209326 Jun 03 10:03:51.754353 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 359/715] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:03:51 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1725 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:03:51.959395 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-6a009991-b9f2-4aaf-89e2-6f8ae8a29633 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Flavor limits 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 10:03:51.959821 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-6a009991-b9f2-4aaf-89e2-6f8ae8a29633 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Image limits 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 10:03:51.960301 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-6a009991-b9f2-4aaf-89e2-6f8ae8a29633 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Flavor pref 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 10:03:51.960877 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-6a009991-b9f2-4aaf-89e2-6f8ae8a29633 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Image pref 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 10:03:51.961268 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-6a009991-b9f2-4aaf-89e2-6f8ae8a29633 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 10:03:51.971361 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6a009991-b9f2-4aaf-89e2-6f8ae8a29633 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:51.971811 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6a009991-b9f2-4aaf-89e2-6f8ae8a29633 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:51.972615 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6a009991-b9f2-4aaf-89e2-6f8ae8a29633 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:51.973157 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6a009991-b9f2-4aaf-89e2-6f8ae8a29633 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:51.990115 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-6a009991-b9f2-4aaf-89e2-6f8ae8a29633 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Getting quotas for project 3e51010dd5d84daf8aa43859e9e7cb6d. Resources: {'ram', 'instances', 'cores'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:03:51.994374 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-6a009991-b9f2-4aaf-89e2-6f8ae8a29633 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Getting quotas for user ce77221a2c8d4c4395bed092c1967b28 and project 3e51010dd5d84daf8aa43859e9e7cb6d. Resources: {'ram', 'instances', 'cores'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:03:52.006036 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-6a009991-b9f2-4aaf-89e2-6f8ae8a29633 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Going to run 1 instances... {{(pid=125066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 10:03:52.008386 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-6a009991-b9f2-4aaf-89e2-6f8ae8a29633 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 17b2f507-9340-486f-92ed-d249b5b78d78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2dd03b-4531-46f3-88da-0380e97b1bd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 10:03:52.161452 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-6a009991-b9f2-4aaf-89e2-6f8ae8a29633 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.933840 Jun 03 10:03:52.162167 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 357/716] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 3 10:03:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 10:03:52.172318 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-f66fcf3b-10b2-48a5-a60b-f665c8da5c35 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:52.173201 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-f66fcf3b-10b2-48a5-a60b-f665c8da5c35 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 17b2f507-9340-486f-92ed-d249b5b78d78] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:52.234021 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f66fcf3b-10b2-48a5-a60b-f665c8da5c35 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:52.243387 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-f66fcf3b-10b2-48a5-a60b-f665c8da5c35 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78" status: 200 len: 1240 microversion: 2.1 time: 0.074965 Jun 03 10:03:52.250059 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 360/717] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:52 2022] GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78 => generated 1240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:52.768556 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-b2668abc-b9e9-4647-8d95-5a160a1af5ad tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:52.769171 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-b2668abc-b9e9-4647-8d95-5a160a1af5ad tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:52.775844 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b2668abc-b9e9-4647-8d95-5a160a1af5ad tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:52.776297 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b2668abc-b9e9-4647-8d95-5a160a1af5ad tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:52.777058 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b2668abc-b9e9-4647-8d95-5a160a1af5ad tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:52.777495 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b2668abc-b9e9-4647-8d95-5a160a1af5ad tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:52.909390 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-b2668abc-b9e9-4647-8d95-5a160a1af5ad tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:52.918410 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-b2668abc-b9e9-4647-8d95-5a160a1af5ad tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:52.920013 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-b2668abc-b9e9-4647-8d95-5a160a1af5ad tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:52.921131 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-b2668abc-b9e9-4647-8d95-5a160a1af5ad tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1725 microversion: 2.20 time: 0.156523 Jun 03 10:03:52.921688 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 358/718] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:03:52 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:03:53.260876 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-15339542-c48c-43a6-897f-d1040e99e804 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:53.261501 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-15339542-c48c-43a6-897f-d1040e99e804 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 17b2f507-9340-486f-92ed-d249b5b78d78] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:53.268449 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-15339542-c48c-43a6-897f-d1040e99e804 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:53.268911 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-15339542-c48c-43a6-897f-d1040e99e804 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:53.269668 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-15339542-c48c-43a6-897f-d1040e99e804 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:53.270140 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-15339542-c48c-43a6-897f-d1040e99e804 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:53.329627 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-15339542-c48c-43a6-897f-d1040e99e804 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:53.337069 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-15339542-c48c-43a6-897f-d1040e99e804 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78" status: 200 len: 1244 microversion: 2.1 time: 0.080336 Jun 03 10:03:53.337632 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 361/719] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:53 2022] GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:53.940157 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-d4cc425e-f395-4f47-9a81-8c31ef483991 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:53.940698 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-d4cc425e-f395-4f47-9a81-8c31ef483991 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:53.947205 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d4cc425e-f395-4f47-9a81-8c31ef483991 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:53.948339 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d4cc425e-f395-4f47-9a81-8c31ef483991 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:53.948673 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d4cc425e-f395-4f47-9a81-8c31ef483991 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:53.948868 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d4cc425e-f395-4f47-9a81-8c31ef483991 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:54.077105 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-d4cc425e-f395-4f47-9a81-8c31ef483991 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:54.085484 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-d4cc425e-f395-4f47-9a81-8c31ef483991 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:54.087018 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-d4cc425e-f395-4f47-9a81-8c31ef483991 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:54.088172 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-d4cc425e-f395-4f47-9a81-8c31ef483991 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1725 microversion: 2.20 time: 0.152191 Jun 03 10:03:54.088726 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 359/720] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:03:53 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:03:54.353843 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-118176bf-5413-45a2-9533-cb2219cb64f7 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:54.354468 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-118176bf-5413-45a2-9533-cb2219cb64f7 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 17b2f507-9340-486f-92ed-d249b5b78d78] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:54.361465 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-118176bf-5413-45a2-9533-cb2219cb64f7 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:54.361937 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-118176bf-5413-45a2-9533-cb2219cb64f7 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:54.362769 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-118176bf-5413-45a2-9533-cb2219cb64f7 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:54.363229 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-118176bf-5413-45a2-9533-cb2219cb64f7 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:54.451570 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-118176bf-5413-45a2-9533-cb2219cb64f7 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:54.460134 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-118176bf-5413-45a2-9533-cb2219cb64f7 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78" status: 200 len: 1300 microversion: 2.1 time: 0.110112 Jun 03 10:03:54.461035 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 362/721] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:54 2022] GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78 => generated 1300 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:55.105874 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-2666dcb5-e37b-4d7e-85d6-e8f82cd18dc4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:55.106510 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-2666dcb5-e37b-4d7e-85d6-e8f82cd18dc4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:55.114490 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2666dcb5-e37b-4d7e-85d6-e8f82cd18dc4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:55.114982 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2666dcb5-e37b-4d7e-85d6-e8f82cd18dc4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:55.115834 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2666dcb5-e37b-4d7e-85d6-e8f82cd18dc4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:55.116548 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2666dcb5-e37b-4d7e-85d6-e8f82cd18dc4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:55.322445 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-2666dcb5-e37b-4d7e-85d6-e8f82cd18dc4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:55.331075 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-2666dcb5-e37b-4d7e-85d6-e8f82cd18dc4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:55.332706 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-2666dcb5-e37b-4d7e-85d6-e8f82cd18dc4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:55.334117 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-2666dcb5-e37b-4d7e-85d6-e8f82cd18dc4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1725 microversion: 2.20 time: 0.232033 Jun 03 10:03:55.334770 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 360/722] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:03:55 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1725 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:03:55.477050 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-a658cbd2-d34a-4e95-be63-76d9c545d236 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:55.478250 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-a658cbd2-d34a-4e95-be63-76d9c545d236 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 17b2f507-9340-486f-92ed-d249b5b78d78] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:55.485317 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a658cbd2-d34a-4e95-be63-76d9c545d236 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:55.486366 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a658cbd2-d34a-4e95-be63-76d9c545d236 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:55.487363 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a658cbd2-d34a-4e95-be63-76d9c545d236 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:55.487953 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a658cbd2-d34a-4e95-be63-76d9c545d236 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:55.745222 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-a658cbd2-d34a-4e95-be63-76d9c545d236 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:55.752927 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-a658cbd2-d34a-4e95-be63-76d9c545d236 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78" status: 200 len: 1366 microversion: 2.1 time: 0.279679 Jun 03 10:03:55.753643 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 363/723] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:55 2022] GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78 => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:56.242441 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-7012dbd6-b389-460a-9a86-6f075d454d83 req-3296c6d4-7abe-4924-9468-cebc884580b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17b2f507-9340-486f-92ed-d249b5b78d78", "tag": "8b1d6a25-ec19-48dd-8b87-919d443e61a6"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:56.256897 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-7012dbd6-b389-460a-9a86-6f075d454d83 req-3296c6d4-7abe-4924-9468-cebc884580b5 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:56.257585 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-7012dbd6-b389-460a-9a86-6f075d454d83 req-3296c6d4-7abe-4924-9468-cebc884580b5 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:56.270128 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-7012dbd6-b389-460a-9a86-6f075d454d83 req-3296c6d4-7abe-4924-9468-cebc884580b5 service nova] Creating event network-changed:8b1d6a25-ec19-48dd-8b87-919d443e61a6 for instance 17b2f507-9340-486f-92ed-d249b5b78d78 on hv-cinder-84456 Jun 03 10:03:56.276668 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-7012dbd6-b389-460a-9a86-6f075d454d83 req-3296c6d4-7abe-4924-9468-cebc884580b5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038989 Jun 03 10:03:56.277580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 361/724] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:03:56.351866 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-e982a1bc-58df-471b-b8ae-00f45bc39cc9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:56.352486 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-e982a1bc-58df-471b-b8ae-00f45bc39cc9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:56.358986 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e982a1bc-58df-471b-b8ae-00f45bc39cc9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:56.359444 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e982a1bc-58df-471b-b8ae-00f45bc39cc9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:56.361008 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e982a1bc-58df-471b-b8ae-00f45bc39cc9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:56.361659 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e982a1bc-58df-471b-b8ae-00f45bc39cc9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:56.581995 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-e982a1bc-58df-471b-b8ae-00f45bc39cc9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:56.590168 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-e982a1bc-58df-471b-b8ae-00f45bc39cc9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:56.591707 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-e982a1bc-58df-471b-b8ae-00f45bc39cc9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:56.592865 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-e982a1bc-58df-471b-b8ae-00f45bc39cc9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1725 microversion: 2.20 time: 0.245007 Jun 03 10:03:56.593646 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 364/725] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:03:56 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1725 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:03:56.770616 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-90764a92-9283-4c2b-bc71-83ccef418a9c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:56.771414 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-90764a92-9283-4c2b-bc71-83ccef418a9c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 17b2f507-9340-486f-92ed-d249b5b78d78] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:56.777783 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-90764a92-9283-4c2b-bc71-83ccef418a9c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:56.778327 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-90764a92-9283-4c2b-bc71-83ccef418a9c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:56.779161 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-90764a92-9283-4c2b-bc71-83ccef418a9c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:56.779656 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-90764a92-9283-4c2b-bc71-83ccef418a9c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:57.217774 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-90764a92-9283-4c2b-bc71-83ccef418a9c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:57.226692 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-90764a92-9283-4c2b-bc71-83ccef418a9c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78" status: 200 len: 1366 microversion: 2.1 time: 0.460882 Jun 03 10:03:57.227455 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 362/726] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:56 2022] GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78 => generated 1366 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:57.611386 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-4b7e06c5-12da-4bce-9608-9187a4167a80 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:57.611995 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-4b7e06c5-12da-4bce-9608-9187a4167a80 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:57.618341 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4b7e06c5-12da-4bce-9608-9187a4167a80 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:57.618784 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4b7e06c5-12da-4bce-9608-9187a4167a80 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:57.619535 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4b7e06c5-12da-4bce-9608-9187a4167a80 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:57.619962 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4b7e06c5-12da-4bce-9608-9187a4167a80 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:57.746888 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-4b7e06c5-12da-4bce-9608-9187a4167a80 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:57.755629 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-4b7e06c5-12da-4bce-9608-9187a4167a80 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:57.757143 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-4b7e06c5-12da-4bce-9608-9187a4167a80 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:57.758336 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-4b7e06c5-12da-4bce-9608-9187a4167a80 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1725 microversion: 2.20 time: 0.150927 Jun 03 10:03:57.759155 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 365/727] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:03:57 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:03:58.243692 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-9092750f-d564-44de-8438-82e430d04e4c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:58.244379 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-9092750f-d564-44de-8438-82e430d04e4c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 17b2f507-9340-486f-92ed-d249b5b78d78] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:58.250826 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9092750f-d564-44de-8438-82e430d04e4c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:58.255425 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9092750f-d564-44de-8438-82e430d04e4c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:58.255425 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9092750f-d564-44de-8438-82e430d04e4c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:58.255425 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9092750f-d564-44de-8438-82e430d04e4c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:58.382128 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-9092750f-d564-44de-8438-82e430d04e4c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:58.389733 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-9092750f-d564-44de-8438-82e430d04e4c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78" status: 200 len: 1366 microversion: 2.1 time: 0.150023 Jun 03 10:03:58.390338 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 363/728] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:58 2022] GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:58.776529 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-c1c33d8f-d04c-40bf-9a6e-fd436a0313b4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:58.777137 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-c1c33d8f-d04c-40bf-9a6e-fd436a0313b4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:58.784237 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c1c33d8f-d04c-40bf-9a6e-fd436a0313b4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:58.784682 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c1c33d8f-d04c-40bf-9a6e-fd436a0313b4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:58.785439 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c1c33d8f-d04c-40bf-9a6e-fd436a0313b4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:58.785875 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c1c33d8f-d04c-40bf-9a6e-fd436a0313b4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:58.911068 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-c1c33d8f-d04c-40bf-9a6e-fd436a0313b4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:58.919462 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-c1c33d8f-d04c-40bf-9a6e-fd436a0313b4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:58.920980 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-c1c33d8f-d04c-40bf-9a6e-fd436a0313b4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:58.922168 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-c1c33d8f-d04c-40bf-9a6e-fd436a0313b4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1725 microversion: 2.20 time: 0.149552 Jun 03 10:03:58.922732 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 366/729] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:03:58 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:03:59.406651 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-36702370-0d83-4288-8a09-e58983e89658 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:59.407263 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-36702370-0d83-4288-8a09-e58983e89658 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 17b2f507-9340-486f-92ed-d249b5b78d78] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:59.414075 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-36702370-0d83-4288-8a09-e58983e89658 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:59.414534 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-36702370-0d83-4288-8a09-e58983e89658 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:59.415403 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-36702370-0d83-4288-8a09-e58983e89658 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:59.415843 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-36702370-0d83-4288-8a09-e58983e89658 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:59.553162 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-36702370-0d83-4288-8a09-e58983e89658 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:59.561087 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-36702370-0d83-4288-8a09-e58983e89658 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78" status: 200 len: 1366 microversion: 2.1 time: 0.158288 Jun 03 10:03:59.561695 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 364/730] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:59 2022] GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:59.940544 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-690fbfd8-5925-4436-9006-12e961b22f9b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:59.941152 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-690fbfd8-5925-4436-9006-12e961b22f9b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:59.947773 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-690fbfd8-5925-4436-9006-12e961b22f9b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:59.948227 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-690fbfd8-5925-4436-9006-12e961b22f9b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:59.948989 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-690fbfd8-5925-4436-9006-12e961b22f9b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:59.949431 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-690fbfd8-5925-4436-9006-12e961b22f9b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:00.074601 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-690fbfd8-5925-4436-9006-12e961b22f9b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:00.083010 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-690fbfd8-5925-4436-9006-12e961b22f9b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:00.084518 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-690fbfd8-5925-4436-9006-12e961b22f9b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:00.085675 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-690fbfd8-5925-4436-9006-12e961b22f9b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1746 microversion: 2.20 time: 0.149071 Jun 03 10:04:00.086273 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 367/731] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:03:59 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1746 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:00.577975 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-3d63b3b1-92a7-4287-a48b-d25a344a6e80 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:00.578577 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-3d63b3b1-92a7-4287-a48b-d25a344a6e80 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 17b2f507-9340-486f-92ed-d249b5b78d78] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:00.585534 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3d63b3b1-92a7-4287-a48b-d25a344a6e80 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:00.586009 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3d63b3b1-92a7-4287-a48b-d25a344a6e80 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:00.586755 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3d63b3b1-92a7-4287-a48b-d25a344a6e80 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:00.587210 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3d63b3b1-92a7-4287-a48b-d25a344a6e80 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:00.712729 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-3d63b3b1-92a7-4287-a48b-d25a344a6e80 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:00.720222 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-3d63b3b1-92a7-4287-a48b-d25a344a6e80 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78" status: 200 len: 1366 microversion: 2.1 time: 0.146192 Jun 03 10:04:00.720795 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 365/732] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:00 2022] GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:01.104479 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-ae90b2f8-bf13-4fd1-87c2-3503dea5a413 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:01.105107 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-ae90b2f8-bf13-4fd1-87c2-3503dea5a413 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:01.112190 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ae90b2f8-bf13-4fd1-87c2-3503dea5a413 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:01.112658 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ae90b2f8-bf13-4fd1-87c2-3503dea5a413 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:01.113410 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ae90b2f8-bf13-4fd1-87c2-3503dea5a413 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:01.113840 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ae90b2f8-bf13-4fd1-87c2-3503dea5a413 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:01.257616 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-ae90b2f8-bf13-4fd1-87c2-3503dea5a413 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:01.271971 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-f3f54b96-028f-496a-93f6-a0d2ba804e9e req-c230a013-712b-4ccf-a26e-a215fb8a11e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17b2f507-9340-486f-92ed-d249b5b78d78", "name": "network-vif-plugged", "status": "completed", "tag": "8b1d6a25-ec19-48dd-8b87-919d443e61a6"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:04:01.274527 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-ae90b2f8-bf13-4fd1-87c2-3503dea5a413 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:01.276069 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-ae90b2f8-bf13-4fd1-87c2-3503dea5a413 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:01.281493 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-ae90b2f8-bf13-4fd1-87c2-3503dea5a413 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1746 microversion: 2.20 time: 0.180923 Jun 03 10:04:01.282183 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 368/733] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:01 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1746 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:01.285057 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-f3f54b96-028f-496a-93f6-a0d2ba804e9e req-c230a013-712b-4ccf-a26e-a215fb8a11e1 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:01.285508 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-f3f54b96-028f-496a-93f6-a0d2ba804e9e req-c230a013-712b-4ccf-a26e-a215fb8a11e1 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:01.297676 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-f3f54b96-028f-496a-93f6-a0d2ba804e9e req-c230a013-712b-4ccf-a26e-a215fb8a11e1 service nova] Creating event network-vif-plugged:8b1d6a25-ec19-48dd-8b87-919d443e61a6 for instance 17b2f507-9340-486f-92ed-d249b5b78d78 on hv-cinder-84456 Jun 03 10:04:01.303674 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-f3f54b96-028f-496a-93f6-a0d2ba804e9e req-c230a013-712b-4ccf-a26e-a215fb8a11e1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100466 Jun 03 10:04:01.304430 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 366/734] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:04:01.736573 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-84958f49-0f35-4bf0-90b0-227cd83d3d1d tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:01.737185 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-84958f49-0f35-4bf0-90b0-227cd83d3d1d tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 17b2f507-9340-486f-92ed-d249b5b78d78] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:01.743207 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-84958f49-0f35-4bf0-90b0-227cd83d3d1d tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:01.743650 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-84958f49-0f35-4bf0-90b0-227cd83d3d1d tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:01.744399 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-84958f49-0f35-4bf0-90b0-227cd83d3d1d tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:01.744822 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-84958f49-0f35-4bf0-90b0-227cd83d3d1d tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:01.874017 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-84958f49-0f35-4bf0-90b0-227cd83d3d1d tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:01.882543 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-84958f49-0f35-4bf0-90b0-227cd83d3d1d tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78" status: 200 len: 1366 microversion: 2.1 time: 0.149923 Jun 03 10:04:01.883164 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 369/735] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:01 2022] GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:02.297650 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell0:SELECT=2 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:02.298473 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell0:SELECT=10 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:02.302513 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-9382a090-186e-4387-9995-94ec5b227dd6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:02.303207 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-9382a090-186e-4387-9995-94ec5b227dd6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:02.309331 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9382a090-186e-4387-9995-94ec5b227dd6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:02.309781 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9382a090-186e-4387-9995-94ec5b227dd6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:02.312375 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9382a090-186e-4387-9995-94ec5b227dd6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:02.312375 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9382a090-186e-4387-9995-94ec5b227dd6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:02.440432 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-9382a090-186e-4387-9995-94ec5b227dd6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:02.448366 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-9382a090-186e-4387-9995-94ec5b227dd6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:02.449874 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-9382a090-186e-4387-9995-94ec5b227dd6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:02.451127 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-9382a090-186e-4387-9995-94ec5b227dd6 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1741 microversion: 2.20 time: 0.154873 Jun 03 10:04:02.460843 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 367/736] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:02 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1741 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:02.927980 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-9347a0af-cf7d-4f75-bf82-85429a9b75f6 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:02.928658 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-9347a0af-cf7d-4f75-bf82-85429a9b75f6 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 17b2f507-9340-486f-92ed-d249b5b78d78] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:02.931997 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell0:SELECT=2 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:02.938369 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9347a0af-cf7d-4f75-bf82-85429a9b75f6 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:02.939051 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9347a0af-cf7d-4f75-bf82-85429a9b75f6 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:02.940273 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9347a0af-cf7d-4f75-bf82-85429a9b75f6 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:02.941507 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9347a0af-cf7d-4f75-bf82-85429a9b75f6 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:03.134326 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-9347a0af-cf7d-4f75-bf82-85429a9b75f6 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:03.143937 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-9347a0af-cf7d-4f75-bf82-85429a9b75f6 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78" status: 200 len: 1366 microversion: 2.1 time: 0.234165 Jun 03 10:04:03.144701 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 370/737] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:02 2022] GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:03.323429 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-ac7520d4-8c7d-4278-9141-814219a645c4 req-16e4ecfd-7796-420c-83b5-b10a5d3d27f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc", "name": "network-vif-plugged", "status": "completed", "tag": "3b6360f1-9329-469d-913b-3b05fed8cd88"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:04:03.334481 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-ac7520d4-8c7d-4278-9141-814219a645c4 req-16e4ecfd-7796-420c-83b5-b10a5d3d27f6 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:03.335130 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-ac7520d4-8c7d-4278-9141-814219a645c4 req-16e4ecfd-7796-420c-83b5-b10a5d3d27f6 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:03.348451 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-ac7520d4-8c7d-4278-9141-814219a645c4 req-16e4ecfd-7796-420c-83b5-b10a5d3d27f6 service nova] Creating event network-vif-plugged:3b6360f1-9329-469d-913b-3b05fed8cd88 for instance a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc on hv-cinder-84456 Jun 03 10:04:03.355351 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-ac7520d4-8c7d-4278-9141-814219a645c4 req-16e4ecfd-7796-420c-83b5-b10a5d3d27f6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035846 Jun 03 10:04:03.356875 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 368/738] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:04:03.476495 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-56e0f7db-f4b9-413f-8cbf-78abf1eb4a12 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:03.476990 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-56e0f7db-f4b9-413f-8cbf-78abf1eb4a12 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:03.483869 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-56e0f7db-f4b9-413f-8cbf-78abf1eb4a12 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:03.484503 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-56e0f7db-f4b9-413f-8cbf-78abf1eb4a12 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:03.485457 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-56e0f7db-f4b9-413f-8cbf-78abf1eb4a12 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:03.485916 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-56e0f7db-f4b9-413f-8cbf-78abf1eb4a12 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:03.632400 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-56e0f7db-f4b9-413f-8cbf-78abf1eb4a12 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:03.638690 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:03.641780 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-56e0f7db-f4b9-413f-8cbf-78abf1eb4a12 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:03.643351 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-56e0f7db-f4b9-413f-8cbf-78abf1eb4a12 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:03.644639 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-56e0f7db-f4b9-413f-8cbf-78abf1eb4a12 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1741 microversion: 2.20 time: 0.173497 Jun 03 10:04:03.645201 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 371/739] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:03 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1741 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:04.161647 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-366a6ee7-a165-493f-ab1b-61189393c9f8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:04.162681 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-366a6ee7-a165-493f-ab1b-61189393c9f8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 17b2f507-9340-486f-92ed-d249b5b78d78] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:04.169527 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-366a6ee7-a165-493f-ab1b-61189393c9f8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:04.170101 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-366a6ee7-a165-493f-ab1b-61189393c9f8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:04.170997 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-366a6ee7-a165-493f-ab1b-61189393c9f8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:04.172359 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-366a6ee7-a165-493f-ab1b-61189393c9f8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:04.319644 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-366a6ee7-a165-493f-ab1b-61189393c9f8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:04.328136 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-366a6ee7-a165-493f-ab1b-61189393c9f8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78" status: 200 len: 1555 microversion: 2.1 time: 0.170593 Jun 03 10:04:04.330001 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 369/740] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:04 2022] GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78 => generated 1555 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:04.346069 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-3149fa27-c773-43cc-89f1-be1cd5e26974 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:04.347206 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-3149fa27-c773-43cc-89f1-be1cd5e26974 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 17b2f507-9340-486f-92ed-d249b5b78d78] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:04.354618 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3149fa27-c773-43cc-89f1-be1cd5e26974 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:04.355074 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3149fa27-c773-43cc-89f1-be1cd5e26974 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:04.355884 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3149fa27-c773-43cc-89f1-be1cd5e26974 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:04.356320 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3149fa27-c773-43cc-89f1-be1cd5e26974 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:04.445550 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-3149fa27-c773-43cc-89f1-be1cd5e26974 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103599 Jun 03 10:04:04.452611 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 372/741] 10.222.0.42 () {58 vars in 1274 bytes} [Fri Jun 3 10:04:04 2022] GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:04:04.662920 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-93d3f8bd-abd2-4f01-b546-9c3d4b256635 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:04.663911 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-93d3f8bd-abd2-4f01-b546-9c3d4b256635 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:04.670542 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-93d3f8bd-abd2-4f01-b546-9c3d4b256635 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:04.670998 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-93d3f8bd-abd2-4f01-b546-9c3d4b256635 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:04.671891 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-93d3f8bd-abd2-4f01-b546-9c3d4b256635 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:04.672332 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-93d3f8bd-abd2-4f01-b546-9c3d4b256635 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:04.931833 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-93d3f8bd-abd2-4f01-b546-9c3d4b256635 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:04.943091 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-93d3f8bd-abd2-4f01-b546-9c3d4b256635 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:04.944620 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-93d3f8bd-abd2-4f01-b546-9c3d4b256635 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:04.945794 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-93d3f8bd-abd2-4f01-b546-9c3d4b256635 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1741 microversion: 2.20 time: 0.286865 Jun 03 10:04:04.946395 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 370/742] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:04 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1741 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:04:05.236362 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-8aa1aa48-d0cc-4a06-83a2-d91353a0c233 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:05.236643 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-8aa1aa48-d0cc-4a06-83a2-d91353a0c233 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:05.243416 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8aa1aa48-d0cc-4a06-83a2-d91353a0c233 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:05.243874 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8aa1aa48-d0cc-4a06-83a2-d91353a0c233 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:05.244648 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8aa1aa48-d0cc-4a06-83a2-d91353a0c233 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:05.245083 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8aa1aa48-d0cc-4a06-83a2-d91353a0c233 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:05.269697 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-8aa1aa48-d0cc-4a06-83a2-d91353a0c233 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f/ips" status: 200 len: 146 microversion: 2.1 time: 0.036978 Jun 03 10:04:05.276085 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 373/743] 10.222.0.42 () {58 vars in 1247 bytes} [Fri Jun 3 10:04:05 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f/ips => generated 146 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:04:05.616371 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-65cbd56c-f2ad-4587-b45d-ea1392d1344e req-b5babd7c-ba1b-48c5-b3a5-0b859c57808c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17b2f507-9340-486f-92ed-d249b5b78d78", "tag": "8b1d6a25-ec19-48dd-8b87-919d443e61a6"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:04:05.625425 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-65cbd56c-f2ad-4587-b45d-ea1392d1344e req-b5babd7c-ba1b-48c5-b3a5-0b859c57808c service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:05.626212 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-65cbd56c-f2ad-4587-b45d-ea1392d1344e req-b5babd7c-ba1b-48c5-b3a5-0b859c57808c service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:05.642264 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-65cbd56c-f2ad-4587-b45d-ea1392d1344e req-b5babd7c-ba1b-48c5-b3a5-0b859c57808c service nova] Creating event network-changed:8b1d6a25-ec19-48dd-8b87-919d443e61a6 for instance 17b2f507-9340-486f-92ed-d249b5b78d78 on hv-cinder-84456 Jun 03 10:04:05.650587 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-65cbd56c-f2ad-4587-b45d-ea1392d1344e req-b5babd7c-ba1b-48c5-b3a5-0b859c57808c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037151 Jun 03 10:04:05.651878 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 371/744] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:04:05.964398 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-0c82089c-e2ba-4c49-9ff5-c42535ae6b63 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:05.965639 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-0c82089c-e2ba-4c49-9ff5-c42535ae6b63 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:05.973025 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0c82089c-e2ba-4c49-9ff5-c42535ae6b63 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:05.973792 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0c82089c-e2ba-4c49-9ff5-c42535ae6b63 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:05.974986 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0c82089c-e2ba-4c49-9ff5-c42535ae6b63 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:05.975574 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0c82089c-e2ba-4c49-9ff5-c42535ae6b63 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:06.269947 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-0c82089c-e2ba-4c49-9ff5-c42535ae6b63 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:06.280546 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-0c82089c-e2ba-4c49-9ff5-c42535ae6b63 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:06.282104 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-0c82089c-e2ba-4c49-9ff5-c42535ae6b63 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:06.283516 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-0c82089c-e2ba-4c49-9ff5-c42535ae6b63 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1741 microversion: 2.20 time: 0.323474 Jun 03 10:04:06.294585 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 374/745] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:05 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1741 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:07.222116 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-e0f84e51-20c5-41fb-9406-7d76d21a90e7 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00732d33-4882-4261-bca9-4da2f065f20a"}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:04:07.223451 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-e0f84e51-20c5-41fb-9406-7d76d21a90e7 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:07.230237 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e0f84e51-20c5-41fb-9406-7d76d21a90e7 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:07.230717 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e0f84e51-20c5-41fb-9406-7d76d21a90e7 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:07.231483 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e0f84e51-20c5-41fb-9406-7d76d21a90e7 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:07.231999 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e0f84e51-20c5-41fb-9406-7d76d21a90e7 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:07.301208 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-f0a810d1-0d66-407c-9952-7ba8f39f2b84 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:07.302730 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-f0a810d1-0d66-407c-9952-7ba8f39f2b84 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:07.310085 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f0a810d1-0d66-407c-9952-7ba8f39f2b84 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:07.310754 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f0a810d1-0d66-407c-9952-7ba8f39f2b84 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:07.311696 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f0a810d1-0d66-407c-9952-7ba8f39f2b84 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:07.312318 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f0a810d1-0d66-407c-9952-7ba8f39f2b84 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:07.460905 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f0a810d1-0d66-407c-9952-7ba8f39f2b84 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:07.473469 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f0a810d1-0d66-407c-9952-7ba8f39f2b84 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:07.475584 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f0a810d1-0d66-407c-9952-7ba8f39f2b84 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:07.476873 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-f0a810d1-0d66-407c-9952-7ba8f39f2b84 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1741 microversion: 2.20 time: 0.179824 Jun 03 10:04:07.477491 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 375/746] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:07 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1741 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:04:08.061176 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-e0f84e51-20c5-41fb-9406-7d76d21a90e7 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "POST /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.844291 Jun 03 10:04:08.067804 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 372/747] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jun 3 10:04:07 2022] POST /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f/os-volume_attachments => generated 194 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:04:08.496816 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-f88ea572-7126-46bf-9b04-d216bf66cc01 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:08.498009 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-f88ea572-7126-46bf-9b04-d216bf66cc01 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:08.504667 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f88ea572-7126-46bf-9b04-d216bf66cc01 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:08.505116 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f88ea572-7126-46bf-9b04-d216bf66cc01 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:08.505877 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f88ea572-7126-46bf-9b04-d216bf66cc01 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:08.506333 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f88ea572-7126-46bf-9b04-d216bf66cc01 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:08.652464 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f88ea572-7126-46bf-9b04-d216bf66cc01 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:08.661719 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f88ea572-7126-46bf-9b04-d216bf66cc01 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:08.663313 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f88ea572-7126-46bf-9b04-d216bf66cc01 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:08.664538 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-f88ea572-7126-46bf-9b04-d216bf66cc01 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1741 microversion: 2.20 time: 0.172166 Jun 03 10:04:08.665135 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 376/748] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:08 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1741 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:04:09.684064 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-f493bcb4-12e3-4b37-b532-d0ce11032cee tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:09.684753 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-f493bcb4-12e3-4b37-b532-d0ce11032cee tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:09.691864 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f493bcb4-12e3-4b37-b532-d0ce11032cee tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:09.692375 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f493bcb4-12e3-4b37-b532-d0ce11032cee tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:09.693391 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f493bcb4-12e3-4b37-b532-d0ce11032cee tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:09.694008 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f493bcb4-12e3-4b37-b532-d0ce11032cee tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:09.849210 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-f493bcb4-12e3-4b37-b532-d0ce11032cee tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:09.857770 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-f493bcb4-12e3-4b37-b532-d0ce11032cee tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:09.859483 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-f493bcb4-12e3-4b37-b532-d0ce11032cee tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:09.860744 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-f493bcb4-12e3-4b37-b532-d0ce11032cee tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1741 microversion: 2.20 time: 0.180932 Jun 03 10:04:09.861318 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 373/749] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:09 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1741 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:10.881901 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-401afafa-a04b-4312-a6ee-0b453ca96faf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:10.882514 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-401afafa-a04b-4312-a6ee-0b453ca96faf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:10.889760 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-401afafa-a04b-4312-a6ee-0b453ca96faf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:10.890618 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-401afafa-a04b-4312-a6ee-0b453ca96faf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:10.891598 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-401afafa-a04b-4312-a6ee-0b453ca96faf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:10.892315 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-401afafa-a04b-4312-a6ee-0b453ca96faf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:11.037593 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-401afafa-a04b-4312-a6ee-0b453ca96faf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:11.045651 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-401afafa-a04b-4312-a6ee-0b453ca96faf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:11.047206 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-401afafa-a04b-4312-a6ee-0b453ca96faf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:11.048578 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-401afafa-a04b-4312-a6ee-0b453ca96faf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1741 microversion: 2.20 time: 0.173362 Jun 03 10:04:11.049441 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 377/750] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:10 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1741 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:12.068313 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-66456227-0830-4e28-9506-e07854622302 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:12.068918 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-66456227-0830-4e28-9506-e07854622302 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:12.076376 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-66456227-0830-4e28-9506-e07854622302 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:12.076827 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-66456227-0830-4e28-9506-e07854622302 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:12.077869 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-66456227-0830-4e28-9506-e07854622302 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:12.078634 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-66456227-0830-4e28-9506-e07854622302 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:12.097135 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:12.212919 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-66456227-0830-4e28-9506-e07854622302 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:12.221836 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-66456227-0830-4e28-9506-e07854622302 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:12.223024 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-66456227-0830-4e28-9506-e07854622302 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:12.224248 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-66456227-0830-4e28-9506-e07854622302 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1741 microversion: 2.20 time: 0.160827 Jun 03 10:04:12.224997 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 374/751] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:12 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1741 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:13.243270 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-7e1e6b20-9f31-4452-b1d6-4b0c7b3e3302 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:13.244483 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-7e1e6b20-9f31-4452-b1d6-4b0c7b3e3302 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:13.251300 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7e1e6b20-9f31-4452-b1d6-4b0c7b3e3302 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:13.256659 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7e1e6b20-9f31-4452-b1d6-4b0c7b3e3302 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:13.256659 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7e1e6b20-9f31-4452-b1d6-4b0c7b3e3302 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:13.256659 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7e1e6b20-9f31-4452-b1d6-4b0c7b3e3302 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:13.391466 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-7e1e6b20-9f31-4452-b1d6-4b0c7b3e3302 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:13.399863 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-7e1e6b20-9f31-4452-b1d6-4b0c7b3e3302 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:13.402713 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-7e1e6b20-9f31-4452-b1d6-4b0c7b3e3302 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:13.404169 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-7e1e6b20-9f31-4452-b1d6-4b0c7b3e3302 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1741 microversion: 2.20 time: 0.166518 Jun 03 10:04:13.405065 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 378/752] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:13 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1741 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:14.423940 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-90896865-ef7f-4bd3-9152-b7c8f0a74f4d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:14.424540 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-90896865-ef7f-4bd3-9152-b7c8f0a74f4d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:14.432010 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-90896865-ef7f-4bd3-9152-b7c8f0a74f4d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:14.432462 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-90896865-ef7f-4bd3-9152-b7c8f0a74f4d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:14.433316 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-90896865-ef7f-4bd3-9152-b7c8f0a74f4d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:14.433660 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-90896865-ef7f-4bd3-9152-b7c8f0a74f4d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:14.563142 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-90896865-ef7f-4bd3-9152-b7c8f0a74f4d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:14.571634 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-90896865-ef7f-4bd3-9152-b7c8f0a74f4d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:14.573182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-90896865-ef7f-4bd3-9152-b7c8f0a74f4d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:14.574492 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-90896865-ef7f-4bd3-9152-b7c8f0a74f4d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1741 microversion: 2.20 time: 0.154904 Jun 03 10:04:14.575055 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 375/753] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:14 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1741 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:15.593007 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-2b3f3476-f7bf-4979-bf14-759fc39f4954 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:15.593544 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-2b3f3476-f7bf-4979-bf14-759fc39f4954 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:15.600306 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2b3f3476-f7bf-4979-bf14-759fc39f4954 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:15.600761 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2b3f3476-f7bf-4979-bf14-759fc39f4954 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:15.601528 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2b3f3476-f7bf-4979-bf14-759fc39f4954 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:15.602151 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2b3f3476-f7bf-4979-bf14-759fc39f4954 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:15.744594 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-2b3f3476-f7bf-4979-bf14-759fc39f4954 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:15.752496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-2b3f3476-f7bf-4979-bf14-759fc39f4954 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:15.754743 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-2b3f3476-f7bf-4979-bf14-759fc39f4954 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:15.755902 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-2b3f3476-f7bf-4979-bf14-759fc39f4954 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1723 microversion: 2.20 time: 0.167146 Jun 03 10:04:15.756470 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 379/754] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:15 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:16.648798 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-1f33422b-77eb-4fdb-ace8-95049bc73a48 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:16.649743 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-1f33422b-77eb-4fdb-ace8-95049bc73a48 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:16.656904 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1f33422b-77eb-4fdb-ace8-95049bc73a48 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:16.657383 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1f33422b-77eb-4fdb-ace8-95049bc73a48 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:16.658164 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1f33422b-77eb-4fdb-ace8-95049bc73a48 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:16.658607 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1f33422b-77eb-4fdb-ace8-95049bc73a48 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:16.687269 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-1f33422b-77eb-4fdb-ace8-95049bc73a48 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042522 Jun 03 10:04:16.687813 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 376/755] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 3 10:04:16 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:04:16.697758 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-6f3653fa-9b64-4a4f-ac14-819fe7afcb8d tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:16.698258 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-6f3653fa-9b64-4a4f-ac14-819fe7afcb8d tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:16.700572 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_api:SELECT=51 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:16.705363 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6f3653fa-9b64-4a4f-ac14-819fe7afcb8d tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:16.705810 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6f3653fa-9b64-4a4f-ac14-819fe7afcb8d tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:16.707186 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6f3653fa-9b64-4a4f-ac14-819fe7afcb8d tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:16.707623 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6f3653fa-9b64-4a4f-ac14-819fe7afcb8d tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:16.737430 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-6f3653fa-9b64-4a4f-ac14-819fe7afcb8d tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f/os-volume_attachments/00732d33-4882-4261-bca9-4da2f065f20a" status: 200 len: 194 microversion: 2.1 time: 0.043725 Jun 03 10:04:16.738029 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 380/756] 10.222.0.42 () {58 vars in 1412 bytes} [Fri Jun 3 10:04:16 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f/os-volume_attachments/00732d33-4882-4261-bca9-4da2f065f20a => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:04:16.775540 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-47fb0cba-1279-41c1-9784-1317ea37234c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:16.776398 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-47fb0cba-1279-41c1-9784-1317ea37234c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:16.782482 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-47fb0cba-1279-41c1-9784-1317ea37234c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:16.782935 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-47fb0cba-1279-41c1-9784-1317ea37234c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:16.783693 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-47fb0cba-1279-41c1-9784-1317ea37234c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:16.784169 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-47fb0cba-1279-41c1-9784-1317ea37234c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:17.154545 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-47fb0cba-1279-41c1-9784-1317ea37234c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:17.162533 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-47fb0cba-1279-41c1-9784-1317ea37234c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:17.164046 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-47fb0cba-1279-41c1-9784-1317ea37234c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:17.165212 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-47fb0cba-1279-41c1-9784-1317ea37234c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1723 microversion: 2.20 time: 0.393610 Jun 03 10:04:17.165771 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 377/757] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:16 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1723 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:18.183730 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-87f9954f-8142-4f2c-b76c-3fdb0e4fbc1d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:18.184367 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-87f9954f-8142-4f2c-b76c-3fdb0e4fbc1d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:18.191159 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-87f9954f-8142-4f2c-b76c-3fdb0e4fbc1d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:18.191612 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-87f9954f-8142-4f2c-b76c-3fdb0e4fbc1d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:18.192388 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-87f9954f-8142-4f2c-b76c-3fdb0e4fbc1d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:18.192827 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-87f9954f-8142-4f2c-b76c-3fdb0e4fbc1d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:18.311120 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-40c757ad-6729-4781-8a41-52ad59f5280b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b040aeb3-4746-42c1-b30e-2151f7168009"}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:04:18.312185 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-40c757ad-6729-4781-8a41-52ad59f5280b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:18.319238 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-40c757ad-6729-4781-8a41-52ad59f5280b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:18.319693 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-40c757ad-6729-4781-8a41-52ad59f5280b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:18.320460 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-40c757ad-6729-4781-8a41-52ad59f5280b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:18.320898 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-40c757ad-6729-4781-8a41-52ad59f5280b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:18.324125 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-87f9954f-8142-4f2c-b76c-3fdb0e4fbc1d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:18.332912 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-87f9954f-8142-4f2c-b76c-3fdb0e4fbc1d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:18.334551 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-87f9954f-8142-4f2c-b76c-3fdb0e4fbc1d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:18.335791 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-87f9954f-8142-4f2c-b76c-3fdb0e4fbc1d tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1726 microversion: 2.20 time: 0.155981 Jun 03 10:04:18.336425 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 381/758] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:18 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:18.357212 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-b7331617-63f9-4a45-ac6b-06b38b5fdc4c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72957583-54b6-4848-a165-914e12a252a6"}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:04:18.358422 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-b7331617-63f9-4a45-ac6b-06b38b5fdc4c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:18.364536 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b7331617-63f9-4a45-ac6b-06b38b5fdc4c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:18.365063 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b7331617-63f9-4a45-ac6b-06b38b5fdc4c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:18.365944 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b7331617-63f9-4a45-ac6b-06b38b5fdc4c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:18.366467 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b7331617-63f9-4a45-ac6b-06b38b5fdc4c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:19.478282 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-40c757ad-6729-4781-8a41-52ad59f5280b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "POST /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.170956 Jun 03 10:04:19.478937 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 378/759] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jun 3 10:04:18 2022] POST /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f/os-volume_attachments => generated 194 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:04:19.486980 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-16fbe7e3-ccf2-461e-bf3d-02e28a32d1ef req-04ebfb0a-1b11-408e-abef-885eb1558cca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc", "name": "network-vif-unplugged", "status": "completed", "tag": "3b6360f1-9329-469d-913b-3b05fed8cd88"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:04:19.487745 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=4 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:19.493361 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-16fbe7e3-ccf2-461e-bf3d-02e28a32d1ef req-04ebfb0a-1b11-408e-abef-885eb1558cca service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:19.493811 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-16fbe7e3-ccf2-461e-bf3d-02e28a32d1ef req-04ebfb0a-1b11-408e-abef-885eb1558cca service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:19.505146 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.compute.server_external_events [req-16fbe7e3-ccf2-461e-bf3d-02e28a32d1ef req-04ebfb0a-1b11-408e-abef-885eb1558cca service nova] Unable to find a host for instance a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc. Dropping event network-vif-unplugged {{(pid=125066) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 03 10:04:19.506064 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-16fbe7e3-ccf2-461e-bf3d-02e28a32d1ef req-04ebfb0a-1b11-408e-abef-885eb1558cca service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025866 Jun 03 10:04:19.506662 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 379/760] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 03 10:04:19.775171 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-b7331617-63f9-4a45-ac6b-06b38b5fdc4c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "POST /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.422188 Jun 03 10:04:19.775793 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 382/761] 10.222.0.42 () {62 vars in 1363 bytes} [Fri Jun 3 10:04:18 2022] POST /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc/os-volume_attachments => generated 188 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 10:04:19.889326 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-b5e327a4-5dd3-4e9e-8d35-674acebdfffc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:19.889961 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-b5e327a4-5dd3-4e9e-8d35-674acebdfffc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:19.897337 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b5e327a4-5dd3-4e9e-8d35-674acebdfffc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:19.897787 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b5e327a4-5dd3-4e9e-8d35-674acebdfffc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:19.898585 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b5e327a4-5dd3-4e9e-8d35-674acebdfffc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:19.899064 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b5e327a4-5dd3-4e9e-8d35-674acebdfffc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:20.569566 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-b5e327a4-5dd3-4e9e-8d35-674acebdfffc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc/os-volume_attachments/72957583-54b6-4848-a165-914e12a252a6" status: 202 len: 0 microversion: 2.20 time: 0.684494 Jun 03 10:04:20.570600 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 380/762] 10.222.0.42 () {60 vars in 1456 bytes} [Fri Jun 3 10:04:19 2022] DELETE /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc/os-volume_attachments/72957583-54b6-4848-a165-914e12a252a6 => generated 0 bytes in 686 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:04:20.627327 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-4bbbcec7-4484-4a4e-b028-4cd71e0b98c9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:04:20.627896 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-4bbbcec7-4484-4a4e-b028-4cd71e0b98c9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:20.635605 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4bbbcec7-4484-4a4e-b028-4cd71e0b98c9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:20.636077 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4bbbcec7-4484-4a4e-b028-4cd71e0b98c9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:20.636838 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4bbbcec7-4484-4a4e-b028-4cd71e0b98c9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:20.637277 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4bbbcec7-4484-4a4e-b028-4cd71e0b98c9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:20.892067 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-4bbbcec7-4484-4a4e-b028-4cd71e0b98c9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "POST /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc/action" status: 202 len: 0 microversion: 2.20 time: 0.268593 Jun 03 10:04:20.895091 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 383/763] 10.222.0.42 () {62 vars in 1318 bytes} [Fri Jun 3 10:04:20 2022] POST /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:04:20.900897 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-fe47fdd2-8811-44e3-8d14-2e2a149018f7 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:20.901559 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-fe47fdd2-8811-44e3-8d14-2e2a149018f7 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:20.908480 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fe47fdd2-8811-44e3-8d14-2e2a149018f7 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:20.909438 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fe47fdd2-8811-44e3-8d14-2e2a149018f7 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:20.910259 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fe47fdd2-8811-44e3-8d14-2e2a149018f7 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:20.910711 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fe47fdd2-8811-44e3-8d14-2e2a149018f7 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:21.046542 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-fe47fdd2-8811-44e3-8d14-2e2a149018f7 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:21.054536 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-fe47fdd2-8811-44e3-8d14-2e2a149018f7 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:21.056035 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-fe47fdd2-8811-44e3-8d14-2e2a149018f7 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:21.057178 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-fe47fdd2-8811-44e3-8d14-2e2a149018f7 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1674 microversion: 2.20 time: 0.160322 Jun 03 10:04:21.057728 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 381/764] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:20 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:22.075462 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-cb81516f-1f8c-4907-9e6c-f6c7b8a8c65b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:22.076070 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-cb81516f-1f8c-4907-9e6c-f6c7b8a8c65b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:22.083088 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-cb81516f-1f8c-4907-9e6c-f6c7b8a8c65b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:22.083533 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-cb81516f-1f8c-4907-9e6c-f6c7b8a8c65b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:22.084432 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-cb81516f-1f8c-4907-9e6c-f6c7b8a8c65b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:22.084816 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-cb81516f-1f8c-4907-9e6c-f6c7b8a8c65b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:22.217648 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-cb81516f-1f8c-4907-9e6c-f6c7b8a8c65b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:22.226432 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-cb81516f-1f8c-4907-9e6c-f6c7b8a8c65b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:22.227920 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-cb81516f-1f8c-4907-9e6c-f6c7b8a8c65b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:22.229069 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-cb81516f-1f8c-4907-9e6c-f6c7b8a8c65b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1674 microversion: 2.20 time: 0.158121 Jun 03 10:04:22.229623 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 384/765] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:22 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:23.247430 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-ec02266a-3dcc-4ef2-9806-b279aa523614 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:23.248184 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-ec02266a-3dcc-4ef2-9806-b279aa523614 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:23.255707 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ec02266a-3dcc-4ef2-9806-b279aa523614 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:23.256381 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ec02266a-3dcc-4ef2-9806-b279aa523614 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:23.257146 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ec02266a-3dcc-4ef2-9806-b279aa523614 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:23.257576 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ec02266a-3dcc-4ef2-9806-b279aa523614 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:23.448668 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-ec02266a-3dcc-4ef2-9806-b279aa523614 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:23.449815 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-ec02266a-3dcc-4ef2-9806-b279aa523614 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:23.451328 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-ec02266a-3dcc-4ef2-9806-b279aa523614 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:23.452483 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-ec02266a-3dcc-4ef2-9806-b279aa523614 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1732 microversion: 2.20 time: 0.209003 Jun 03 10:04:23.453042 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 382/766] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:23 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1732 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:24.469842 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-375b1fd7-7a25-461a-b1ef-091dc1745820 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:24.470481 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-375b1fd7-7a25-461a-b1ef-091dc1745820 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:24.477545 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-375b1fd7-7a25-461a-b1ef-091dc1745820 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:24.478033 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-375b1fd7-7a25-461a-b1ef-091dc1745820 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:24.478815 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-375b1fd7-7a25-461a-b1ef-091dc1745820 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:24.479452 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-375b1fd7-7a25-461a-b1ef-091dc1745820 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:24.503828 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:24.631066 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-375b1fd7-7a25-461a-b1ef-091dc1745820 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:24.639356 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-375b1fd7-7a25-461a-b1ef-091dc1745820 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:24.640851 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-375b1fd7-7a25-461a-b1ef-091dc1745820 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:24.642048 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-375b1fd7-7a25-461a-b1ef-091dc1745820 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1732 microversion: 2.20 time: 0.176116 Jun 03 10:04:24.642629 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 385/767] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:24 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:04:25.661927 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-4ceb7100-3504-4aa5-8f45-e4d80162b140 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:25.662704 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-4ceb7100-3504-4aa5-8f45-e4d80162b140 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:25.669578 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4ceb7100-3504-4aa5-8f45-e4d80162b140 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:25.670083 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4ceb7100-3504-4aa5-8f45-e4d80162b140 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:25.671110 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4ceb7100-3504-4aa5-8f45-e4d80162b140 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:25.671551 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4ceb7100-3504-4aa5-8f45-e4d80162b140 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:25.816894 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-4ceb7100-3504-4aa5-8f45-e4d80162b140 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:25.827320 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-4ceb7100-3504-4aa5-8f45-e4d80162b140 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:25.828813 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-4ceb7100-3504-4aa5-8f45-e4d80162b140 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:25.830141 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-4ceb7100-3504-4aa5-8f45-e4d80162b140 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1732 microversion: 2.20 time: 0.173379 Jun 03 10:04:25.830769 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 383/768] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:25 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:26.848216 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-9bacad4b-7f85-4f6c-8675-9a9bea89d126 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:26.848874 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-9bacad4b-7f85-4f6c-8675-9a9bea89d126 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:26.855747 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9bacad4b-7f85-4f6c-8675-9a9bea89d126 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:26.856540 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9bacad4b-7f85-4f6c-8675-9a9bea89d126 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:26.857570 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9bacad4b-7f85-4f6c-8675-9a9bea89d126 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:26.858132 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9bacad4b-7f85-4f6c-8675-9a9bea89d126 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:27.012415 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-9bacad4b-7f85-4f6c-8675-9a9bea89d126 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:27.021047 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-9bacad4b-7f85-4f6c-8675-9a9bea89d126 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:27.022879 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-9bacad4b-7f85-4f6c-8675-9a9bea89d126 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:27.024152 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-9bacad4b-7f85-4f6c-8675-9a9bea89d126 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1732 microversion: 2.20 time: 0.179844 Jun 03 10:04:27.024800 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 386/769] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:26 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1732 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:28.043892 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-8b31bfeb-d1ca-4d7a-9507-5d7b305f7472 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:28.044500 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-8b31bfeb-d1ca-4d7a-9507-5d7b305f7472 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:28.051438 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8b31bfeb-d1ca-4d7a-9507-5d7b305f7472 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:28.054390 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8b31bfeb-d1ca-4d7a-9507-5d7b305f7472 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:28.055227 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8b31bfeb-d1ca-4d7a-9507-5d7b305f7472 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:28.055680 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8b31bfeb-d1ca-4d7a-9507-5d7b305f7472 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:28.199767 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-8b31bfeb-d1ca-4d7a-9507-5d7b305f7472 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:28.208891 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-8b31bfeb-d1ca-4d7a-9507-5d7b305f7472 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:28.210404 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-8b31bfeb-d1ca-4d7a-9507-5d7b305f7472 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:28.211593 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-8b31bfeb-d1ca-4d7a-9507-5d7b305f7472 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1732 microversion: 2.20 time: 0.171602 Jun 03 10:04:28.212478 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 384/770] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:28 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:29.032331 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-7d2b97d5-5b15-40b9-aa6c-f444a6deee0b tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:29.032854 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-7d2b97d5-5b15-40b9-aa6c-f444a6deee0b tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:29.056936 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7d2b97d5-5b15-40b9-aa6c-f444a6deee0b tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:29.057388 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7d2b97d5-5b15-40b9-aa6c-f444a6deee0b tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:29.058193 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7d2b97d5-5b15-40b9-aa6c-f444a6deee0b tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:29.058625 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7d2b97d5-5b15-40b9-aa6c-f444a6deee0b tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:29.087783 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-7d2b97d5-5b15-40b9-aa6c-f444a6deee0b tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Going to try to terminate instance {{(pid=125065) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:04:29.230388 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-5091915f-2575-42da-8313-89322448f67c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:29.231320 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-5091915f-2575-42da-8313-89322448f67c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:29.238861 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5091915f-2575-42da-8313-89322448f67c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:29.239447 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5091915f-2575-42da-8313-89322448f67c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:29.240219 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5091915f-2575-42da-8313-89322448f67c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:29.240836 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5091915f-2575-42da-8313-89322448f67c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:29.421768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-7d2b97d5-5b15-40b9-aa6c-f444a6deee0b tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 204 len: 0 microversion: 2.1 time: 0.392901 Jun 03 10:04:29.426244 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 387/771] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 3 10:04:29 2022] DELETE /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:04:29.432289 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-d92743b0-6e9b-49f6-8b09-18396d9f8165 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:29.433158 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-d92743b0-6e9b-49f6-8b09-18396d9f8165 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:29.443137 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d92743b0-6e9b-49f6-8b09-18396d9f8165 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:29.443591 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d92743b0-6e9b-49f6-8b09-18396d9f8165 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:29.444364 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d92743b0-6e9b-49f6-8b09-18396d9f8165 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:29.444799 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d92743b0-6e9b-49f6-8b09-18396d9f8165 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:29.604624 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-5091915f-2575-42da-8313-89322448f67c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:29.613010 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-5091915f-2575-42da-8313-89322448f67c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:29.614534 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-5091915f-2575-42da-8313-89322448f67c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:29.615706 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-5091915f-2575-42da-8313-89322448f67c tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1732 microversion: 2.20 time: 0.389701 Jun 03 10:04:29.626374 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 385/772] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:29 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1732 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:04:29.635441 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-d92743b0-6e9b-49f6-8b09-18396d9f8165 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:29.644661 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-d92743b0-6e9b-49f6-8b09-18396d9f8165 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1576 microversion: 2.1 time: 0.217116 Jun 03 10:04:29.645550 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 388/773] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:29 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1576 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:30.632689 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-60c5bc23-30c4-4a2f-a8e8-e82d013e4668 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:30.633549 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-60c5bc23-30c4-4a2f-a8e8-e82d013e4668 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:30.640526 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-60c5bc23-30c4-4a2f-a8e8-e82d013e4668 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:30.641075 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-60c5bc23-30c4-4a2f-a8e8-e82d013e4668 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:30.641973 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-60c5bc23-30c4-4a2f-a8e8-e82d013e4668 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:30.642467 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-60c5bc23-30c4-4a2f-a8e8-e82d013e4668 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:30.663017 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-3416bc5e-1fff-43fd-8786-789d8a33a4a5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:30.663766 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-3416bc5e-1fff-43fd-8786-789d8a33a4a5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:30.670850 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3416bc5e-1fff-43fd-8786-789d8a33a4a5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:30.671297 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3416bc5e-1fff-43fd-8786-789d8a33a4a5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:30.672063 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3416bc5e-1fff-43fd-8786-789d8a33a4a5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:30.672491 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3416bc5e-1fff-43fd-8786-789d8a33a4a5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:30.851811 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-60c5bc23-30c4-4a2f-a8e8-e82d013e4668 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:30.860800 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-60c5bc23-30c4-4a2f-a8e8-e82d013e4668 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:30.862806 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-60c5bc23-30c4-4a2f-a8e8-e82d013e4668 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:30.864912 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-60c5bc23-30c4-4a2f-a8e8-e82d013e4668 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1732 microversion: 2.20 time: 0.236089 Jun 03 10:04:30.866580 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-3416bc5e-1fff-43fd-8786-789d8a33a4a5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:30.875184 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 386/774] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:30 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1732 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:30.878486 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-3416bc5e-1fff-43fd-8786-789d8a33a4a5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1576 microversion: 2.1 time: 0.219508 Jun 03 10:04:30.879433 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 389/775] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:30 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1576 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:04:31.883555 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-8f76f2a6-0bad-4d5d-8d2c-5372b892e506 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:31.884784 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-8f76f2a6-0bad-4d5d-8d2c-5372b892e506 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:31.892597 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8f76f2a6-0bad-4d5d-8d2c-5372b892e506 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:31.894682 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8f76f2a6-0bad-4d5d-8d2c-5372b892e506 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:31.894682 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8f76f2a6-0bad-4d5d-8d2c-5372b892e506 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:31.895105 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8f76f2a6-0bad-4d5d-8d2c-5372b892e506 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:31.897309 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-b826bcc7-29d7-4f03-8139-3fa606f7e250 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:31.899232 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-b826bcc7-29d7-4f03-8139-3fa606f7e250 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:31.905915 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b826bcc7-29d7-4f03-8139-3fa606f7e250 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:31.906395 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b826bcc7-29d7-4f03-8139-3fa606f7e250 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:31.907164 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b826bcc7-29d7-4f03-8139-3fa606f7e250 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:31.907597 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b826bcc7-29d7-4f03-8139-3fa606f7e250 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:32.090443 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-8f76f2a6-0bad-4d5d-8d2c-5372b892e506 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:32.099175 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-8f76f2a6-0bad-4d5d-8d2c-5372b892e506 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:32.100723 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-8f76f2a6-0bad-4d5d-8d2c-5372b892e506 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:32.101927 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-8f76f2a6-0bad-4d5d-8d2c-5372b892e506 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1732 microversion: 2.20 time: 0.222445 Jun 03 10:04:32.107011 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 387/776] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:31 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1732 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:32.119877 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-b826bcc7-29d7-4f03-8139-3fa606f7e250 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:32.127587 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-b826bcc7-29d7-4f03-8139-3fa606f7e250 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1576 microversion: 2.1 time: 0.234723 Jun 03 10:04:32.128509 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 390/777] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:31 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1576 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:33.121568 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-745e98cf-ea75-48c4-b8d4-0288f5f275f8 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:33.122203 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-745e98cf-ea75-48c4-b8d4-0288f5f275f8 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:33.129397 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-745e98cf-ea75-48c4-b8d4-0288f5f275f8 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:33.129844 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-745e98cf-ea75-48c4-b8d4-0288f5f275f8 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:33.130638 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-745e98cf-ea75-48c4-b8d4-0288f5f275f8 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:33.131079 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-745e98cf-ea75-48c4-b8d4-0288f5f275f8 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:33.133877 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:33.144722 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-db2b9155-6841-489a-a919-b907408232ad tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:33.147229 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-db2b9155-6841-489a-a919-b907408232ad tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:33.151934 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-db2b9155-6841-489a-a919-b907408232ad tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:33.152371 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-db2b9155-6841-489a-a919-b907408232ad tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:33.153139 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-db2b9155-6841-489a-a919-b907408232ad tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:33.153580 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-db2b9155-6841-489a-a919-b907408232ad tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:33.331796 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-745e98cf-ea75-48c4-b8d4-0288f5f275f8 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:33.339486 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-db2b9155-6841-489a-a919-b907408232ad tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:33.340016 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-745e98cf-ea75-48c4-b8d4-0288f5f275f8 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:33.341528 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-745e98cf-ea75-48c4-b8d4-0288f5f275f8 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:33.342730 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-745e98cf-ea75-48c4-b8d4-0288f5f275f8 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1732 microversion: 2.20 time: 0.225088 Jun 03 10:04:33.343289 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 388/778] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:33 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1732 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:33.347484 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-db2b9155-6841-489a-a919-b907408232ad tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1576 microversion: 2.1 time: 0.206617 Jun 03 10:04:33.348041 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 391/779] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:33 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1576 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:04:34.360548 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-5b1b2058-06fe-4d7c-a9d2-368e473008c9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:34.361232 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-5b1b2058-06fe-4d7c-a9d2-368e473008c9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:34.364697 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-7f820db2-e6cf-4ae9-856b-5f4e16839fb9 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:34.365309 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-7f820db2-e6cf-4ae9-856b-5f4e16839fb9 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:34.368527 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5b1b2058-06fe-4d7c-a9d2-368e473008c9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:34.368986 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5b1b2058-06fe-4d7c-a9d2-368e473008c9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:34.369757 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5b1b2058-06fe-4d7c-a9d2-368e473008c9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:34.370221 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5b1b2058-06fe-4d7c-a9d2-368e473008c9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:34.371951 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7f820db2-e6cf-4ae9-856b-5f4e16839fb9 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:34.372401 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7f820db2-e6cf-4ae9-856b-5f4e16839fb9 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:34.373329 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7f820db2-e6cf-4ae9-856b-5f4e16839fb9 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:34.373757 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7f820db2-e6cf-4ae9-856b-5f4e16839fb9 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:34.565195 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-5b1b2058-06fe-4d7c-a9d2-368e473008c9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:34.568897 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-7f820db2-e6cf-4ae9-856b-5f4e16839fb9 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:34.573576 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-5b1b2058-06fe-4d7c-a9d2-368e473008c9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:34.575126 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-5b1b2058-06fe-4d7c-a9d2-368e473008c9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:34.576293 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-5b1b2058-06fe-4d7c-a9d2-368e473008c9 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1732 microversion: 2.20 time: 0.219805 Jun 03 10:04:34.576410 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-7f820db2-e6cf-4ae9-856b-5f4e16839fb9 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1576 microversion: 2.1 time: 0.215930 Jun 03 10:04:34.577063 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 389/781] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:34 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1732 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:34.577192 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 392/781] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:34 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1576 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:04:35.595863 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-393822a8-73b8-4213-a3f0-e23de899b9cc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:35.596424 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-393822a8-73b8-4213-a3f0-e23de899b9cc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:35.599295 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-ff5e380c-d286-46ad-b9ab-d01b2a073500 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:35.599908 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-ff5e380c-d286-46ad-b9ab-d01b2a073500 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:35.603292 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-393822a8-73b8-4213-a3f0-e23de899b9cc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:35.603747 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-393822a8-73b8-4213-a3f0-e23de899b9cc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:35.604558 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-393822a8-73b8-4213-a3f0-e23de899b9cc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:35.605004 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-393822a8-73b8-4213-a3f0-e23de899b9cc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:35.606512 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ff5e380c-d286-46ad-b9ab-d01b2a073500 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:35.606967 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ff5e380c-d286-46ad-b9ab-d01b2a073500 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:35.607772 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ff5e380c-d286-46ad-b9ab-d01b2a073500 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:35.608214 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ff5e380c-d286-46ad-b9ab-d01b2a073500 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:35.802689 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-393822a8-73b8-4213-a3f0-e23de899b9cc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:35.806395 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-ff5e380c-d286-46ad-b9ab-d01b2a073500 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:35.810981 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-393822a8-73b8-4213-a3f0-e23de899b9cc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:35.812492 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-393822a8-73b8-4213-a3f0-e23de899b9cc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:35.813680 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-393822a8-73b8-4213-a3f0-e23de899b9cc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1732 microversion: 2.20 time: 0.222927 Jun 03 10:04:35.813936 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-ff5e380c-d286-46ad-b9ab-d01b2a073500 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1576 microversion: 2.1 time: 0.218330 Jun 03 10:04:35.824182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 390/783] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:35 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1732 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:35.824385 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 393/783] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:35 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1576 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:04:36.509651 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-227eabc5-586c-477d-8690-a19e061cc4a2 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:36.510812 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-227eabc5-586c-477d-8690-a19e061cc4a2 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:36.516977 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-227eabc5-586c-477d-8690-a19e061cc4a2 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:36.528431 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-227eabc5-586c-477d-8690-a19e061cc4a2 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:36.528431 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-227eabc5-586c-477d-8690-a19e061cc4a2 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:36.528431 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-227eabc5-586c-477d-8690-a19e061cc4a2 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:36.548676 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-227eabc5-586c-477d-8690-a19e061cc4a2 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043433 Jun 03 10:04:36.549786 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 391/784] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 3 10:04:36 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:04:36.695109 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-28378db2-0d87-42ed-925a-b00d46a2ca44 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:36.695640 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-28378db2-0d87-42ed-925a-b00d46a2ca44 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:36.703318 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-28378db2-0d87-42ed-925a-b00d46a2ca44 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:36.703899 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-28378db2-0d87-42ed-925a-b00d46a2ca44 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:36.704675 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-28378db2-0d87-42ed-925a-b00d46a2ca44 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:36.705106 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-28378db2-0d87-42ed-925a-b00d46a2ca44 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:36.739921 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-28378db2-0d87-42ed-925a-b00d46a2ca44 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f/os-volume_attachments/00732d33-4882-4261-bca9-4da2f065f20a" status: 200 len: 194 microversion: 2.1 time: 0.047431 Jun 03 10:04:36.739921 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 394/785] 10.222.0.42 () {58 vars in 1412 bytes} [Fri Jun 3 10:04:36 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f/os-volume_attachments/00732d33-4882-4261-bca9-4da2f065f20a => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:04:36.740901 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-9430c137-43fa-4ab7-a890-550991f46df6 req-c512e82f-4d15-4316-81d8-76348b7f6a8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b4620df-63bb-4550-b854-4c81bb1219e0", "name": "network-vif-deleted", "tag": "9c77efae-7eef-404e-beac-b5252e585eb9"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:04:36.750008 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-c365f0a9-3a32-43d8-a1cf-afc7dec21ddd tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:36.750759 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-c365f0a9-3a32-43d8-a1cf-afc7dec21ddd tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:36.751944 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-9430c137-43fa-4ab7-a890-550991f46df6 req-c512e82f-4d15-4316-81d8-76348b7f6a8e service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:36.752426 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-9430c137-43fa-4ab7-a890-550991f46df6 req-c512e82f-4d15-4316-81d8-76348b7f6a8e service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:36.756922 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c365f0a9-3a32-43d8-a1cf-afc7dec21ddd tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:36.757370 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c365f0a9-3a32-43d8-a1cf-afc7dec21ddd tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:36.758434 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c365f0a9-3a32-43d8-a1cf-afc7dec21ddd tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:36.758863 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c365f0a9-3a32-43d8-a1cf-afc7dec21ddd tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:36.764242 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-9430c137-43fa-4ab7-a890-550991f46df6 req-c512e82f-4d15-4316-81d8-76348b7f6a8e service nova] Creating event network-vif-deleted:9c77efae-7eef-404e-beac-b5252e585eb9 for instance 7b4620df-63bb-4550-b854-4c81bb1219e0 on hv-cinder-84456 Jun 03 10:04:36.769928 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-9430c137-43fa-4ab7-a890-550991f46df6 req-c512e82f-4d15-4316-81d8-76348b7f6a8e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034028 Jun 03 10:04:36.773823 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 392/786] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:04:36.837678 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-fa502255-1cc9-40b1-a33e-724ca7063b4a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:36.838713 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-fa502255-1cc9-40b1-a33e-724ca7063b4a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:36.846249 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fa502255-1cc9-40b1-a33e-724ca7063b4a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:36.846918 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fa502255-1cc9-40b1-a33e-724ca7063b4a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:36.847870 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fa502255-1cc9-40b1-a33e-724ca7063b4a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:36.848462 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fa502255-1cc9-40b1-a33e-724ca7063b4a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:36.854030 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.objects.instance [None req-c365f0a9-3a32-43d8-a1cf-afc7dec21ddd tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lazy-loading 'services' on Instance uuid cbff6766-51d9-41a5-b9f9-bdb117cad35f {{(pid=125065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:04:37.001791 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-fa502255-1cc9-40b1-a33e-724ca7063b4a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:37.011521 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-fa502255-1cc9-40b1-a33e-724ca7063b4a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:37.013387 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-fa502255-1cc9-40b1-a33e-724ca7063b4a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:37.014168 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-fa502255-1cc9-40b1-a33e-724ca7063b4a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1732 microversion: 2.20 time: 0.182828 Jun 03 10:04:37.014716 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 393/787] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:36 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:04:37.020025 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-43ff8478-0f23-4a8c-a527-5d20532750a8 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:37.020622 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-43ff8478-0f23-4a8c-a527-5d20532750a8 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:37.026583 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-43ff8478-0f23-4a8c-a527-5d20532750a8 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:37.027029 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-43ff8478-0f23-4a8c-a527-5d20532750a8 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:37.027785 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-43ff8478-0f23-4a8c-a527-5d20532750a8 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:37.028211 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-43ff8478-0f23-4a8c-a527-5d20532750a8 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:37.080514 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-c365f0a9-3a32-43d8-a1cf-afc7dec21ddd tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f/os-volume_attachments/00732d33-4882-4261-bca9-4da2f065f20a" status: 202 len: 0 microversion: 2.1 time: 0.334133 Jun 03 10:04:37.084766 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 395/788] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jun 3 10:04:36 2022] DELETE /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f/os-volume_attachments/00732d33-4882-4261-bca9-4da2f065f20a => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:04:37.122531 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-43ff8478-0f23-4a8c-a527-5d20532750a8 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:37.133621 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-43ff8478-0f23-4a8c-a527-5d20532750a8 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1226 microversion: 2.1 time: 0.117256 Jun 03 10:04:37.134459 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 394/789] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:37 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1226 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:38.034351 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-d172fff8-b078-42d6-b381-0afd10b22f16 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:38.035106 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-d172fff8-b078-42d6-b381-0afd10b22f16 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:38.041311 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d172fff8-b078-42d6-b381-0afd10b22f16 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:38.041756 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d172fff8-b078-42d6-b381-0afd10b22f16 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:38.042546 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d172fff8-b078-42d6-b381-0afd10b22f16 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:38.042978 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d172fff8-b078-42d6-b381-0afd10b22f16 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:38.154464 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-8fba8c7f-5540-4f79-acab-eb2a651a2f69 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:38.155080 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-8fba8c7f-5540-4f79-acab-eb2a651a2f69 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:38.162277 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8fba8c7f-5540-4f79-acab-eb2a651a2f69 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:38.162666 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8fba8c7f-5540-4f79-acab-eb2a651a2f69 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:38.163444 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8fba8c7f-5540-4f79-acab-eb2a651a2f69 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:38.163883 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8fba8c7f-5540-4f79-acab-eb2a651a2f69 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:38.196173 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-d172fff8-b078-42d6-b381-0afd10b22f16 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:38.205565 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8fba8c7f-5540-4f79-acab-eb2a651a2f69 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:38.206075 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8fba8c7f-5540-4f79-acab-eb2a651a2f69 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:38.206709 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.objects.instance [None req-8fba8c7f-5540-4f79-acab-eb2a651a2f69 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lazy-loading 'fault' on Instance uuid 7b4620df-63bb-4550-b854-4c81bb1219e0 {{(pid=125066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:04:38.209481 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-d172fff8-b078-42d6-b381-0afd10b22f16 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:38.211130 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-d172fff8-b078-42d6-b381-0afd10b22f16 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:38.214918 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-d172fff8-b078-42d6-b381-0afd10b22f16 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1732 microversion: 2.20 time: 0.183412 Jun 03 10:04:38.214918 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 396/790] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:38 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1732 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:38.255217 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-8fba8c7f-5540-4f79-acab-eb2a651a2f69 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:38.263007 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-8fba8c7f-5540-4f79-acab-eb2a651a2f69 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 200 len: 1231 microversion: 2.1 time: 0.116342 Jun 03 10:04:38.266331 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 395/791] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:38 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 1231 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:39.179477 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-ff680fa2-bcce-4bef-86f5-2b923f666d40 req-ec194ea7-5ecf-4da9-8be5-68ffcb432050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc", "name": "network-vif-plugged", "status": "completed", "tag": "3b6360f1-9329-469d-913b-3b05fed8cd88"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:04:39.188017 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-ff680fa2-bcce-4bef-86f5-2b923f666d40 req-ec194ea7-5ecf-4da9-8be5-68ffcb432050 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:39.188458 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-ff680fa2-bcce-4bef-86f5-2b923f666d40 req-ec194ea7-5ecf-4da9-8be5-68ffcb432050 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:39.199851 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-ff680fa2-bcce-4bef-86f5-2b923f666d40 req-ec194ea7-5ecf-4da9-8be5-68ffcb432050 service nova] Creating event network-vif-plugged:3b6360f1-9329-469d-913b-3b05fed8cd88 for instance a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc on hv-cinder-84456 Jun 03 10:04:39.204515 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-ff680fa2-bcce-4bef-86f5-2b923f666d40 req-ec194ea7-5ecf-4da9-8be5-68ffcb432050 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028690 Jun 03 10:04:39.205090 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 397/792] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:04:39.233651 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-52915fec-ce1d-4110-87cf-672bf3f81de5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:39.233651 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-52915fec-ce1d-4110-87cf-672bf3f81de5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:39.238544 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-52915fec-ce1d-4110-87cf-672bf3f81de5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:39.239109 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-52915fec-ce1d-4110-87cf-672bf3f81de5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:39.239948 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-52915fec-ce1d-4110-87cf-672bf3f81de5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:39.240456 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-52915fec-ce1d-4110-87cf-672bf3f81de5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:39.274802 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-c7d1e261-aaac-4148-9fbe-59881782a4f6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:39.275432 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-c7d1e261-aaac-4148-9fbe-59881782a4f6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:39.281917 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c7d1e261-aaac-4148-9fbe-59881782a4f6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:39.285149 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c7d1e261-aaac-4148-9fbe-59881782a4f6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:39.285149 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c7d1e261-aaac-4148-9fbe-59881782a4f6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:39.285149 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c7d1e261-aaac-4148-9fbe-59881782a4f6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:39.316647 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-c7d1e261-aaac-4148-9fbe-59881782a4f6 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f/os-volume_attachments/b040aeb3-4746-42c1-b30e-2151f7168009" status: 200 len: 194 microversion: 2.1 time: 0.046593 Jun 03 10:04:39.317262 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 398/793] 10.222.0.42 () {58 vars in 1412 bytes} [Fri Jun 3 10:04:39 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f/os-volume_attachments/b040aeb3-4746-42c1-b30e-2151f7168009 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:04:39.327393 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-6c22f4ee-7f26-4da9-8305-e7b0bf949f5c tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:39.328043 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-6c22f4ee-7f26-4da9-8305-e7b0bf949f5c tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:39.334168 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6c22f4ee-7f26-4da9-8305-e7b0bf949f5c tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:39.334619 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6c22f4ee-7f26-4da9-8305-e7b0bf949f5c tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:39.335391 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6c22f4ee-7f26-4da9-8305-e7b0bf949f5c tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:39.336321 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6c22f4ee-7f26-4da9-8305-e7b0bf949f5c tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:39.354244 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.wsgi [None req-6c22f4ee-7f26-4da9-8305-e7b0bf949f5c tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] HTTP exception thrown: Instance 7b4620df-63bb-4550-b854-4c81bb1219e0 could not be found. Jun 03 10:04:39.355899 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-6c22f4ee-7f26-4da9-8305-e7b0bf949f5c tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Request method failure captured: Jun 03 10:04:39.355899 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: request: GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 HTTP/1.1 Jun 03 10:04:39.355899 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept: application/json Jun 03 10:04:39.355899 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept-Encoding: identity Jun 03 10:04:39.355899 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Connection: close Jun 03 10:04:39.355899 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Length: 0 Jun 03 10:04:39.355899 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Type: application/json Jun 03 10:04:39.355899 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Host: 10.222.0.42 Jun 03 10:04:39.355899 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Openstack-System-Scope: None Jun 03 10:04:39.355899 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: User-Agent: python-urllib3/1.26.9 Jun 03 10:04:39.355899 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Auth-Token: gAAAAABimdvmkmGByaxV5IeFM7hJ72QONjbut4RWYIfFr5aVIbzOjdxlJ9aZ2CQ1SicxV3VleVIT9XOasCRkBeSPwdPEUrCDUvTcJDSl89v9NVB0xtOls7A2GEnUx8NQAn8uXq2UUjCDbFii-wi1XCU9uJe7u4yUSWQzt4fjNcbcMLG98mSuols Jun 03 10:04:39.355899 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Id: None Jun 03 10:04:39.355899 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Name: None Jun 03 10:04:39.355899 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Identity-Status: Confirmed Jun 03 10:04:39.355899 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Is-Admin-Project: True Jun 03 10:04:39.355899 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Id: default Jun 03 10:04:39.355899 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Name: Default Jun 03 10:04:39.355899 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Id: 5476f21b29944eb69e32a2d97b328aed Jun 03 10:04:39.355899 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Name: tempest-TestVolumeBootPattern-70577832 Jun 03 10:04:39.355899 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Role: member,reader Jun 03 10:04:39.355899 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Roles: member,reader Jun 03 10:04:39.357500 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5476f21b29944eb69e32a2d97b328aed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5476f21b29944eb69e32a2d97b328aed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5476f21b29944eb69e32a2d97b328aed", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5476f21b29944eb69e32a2d97b328aed"}]}] Jun 03 10:04:39.357500 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant: tempest-TestVolumeBootPattern-70577832 Jun 03 10:04:39.357500 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Id: 5476f21b29944eb69e32a2d97b328aed Jun 03 10:04:39.357500 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Name: tempest-TestVolumeBootPattern-70577832 Jun 03 10:04:39.357500 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User: tempest-TestVolumeBootPattern-70577832-project Jun 03 10:04:39.357500 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Id: default Jun 03 10:04:39.357500 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Name: Default Jun 03 10:04:39.357500 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Id: 646fecf4405c41a0bc062c6b54fd311c Jun 03 10:04:39.357500 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Name: tempest-TestVolumeBootPattern-70577832-project Jun 03 10:04:39.357500 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: method: > Jun 03 10:04:39.357500 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: exception: Instance 7b4620df-63bb-4550-b854-4c81bb1219e0 could not be found. Jun 03 10:04:39.357500 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: action_args: {'id': '7b4620df-63bb-4550-b854-4c81bb1219e0'} Jun 03 10:04:39.358489 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:04:39.358489 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:04:39.358489 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:04:39.358489 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:04:39.358489 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:04:39.358489 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:04:39.358489 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:04:39.358489 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:04:39.358489 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:04:39.358489 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:04:39.358489 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b4620df-63bb-4550-b854-4c81bb1219e0 could not be found. Jun 03 10:04:39.358489 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:04:39.358489 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:04:39.358489 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:04:39.358489 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:04:39.358489 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:04:39.358489 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:04:39.358489 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:04:39.358489 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:04:39.358489 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:04:39.360374 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:04:39.360374 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:04:39.360374 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:04:39.360374 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:04:39.360374 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:04:39.360374 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:04:39.360374 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:04:39.360374 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b4620df-63bb-4550-b854-4c81bb1219e0 could not be found. Jun 03 10:04:39.360374 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:04:39.360374 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:04:39.360374 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:04:39.360374 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:04:39.360374 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:04:39.360374 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:04:39.360374 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:04:39.360374 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:04:39.360374 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b4620df-63bb-4550-b854-4c81bb1219e0 could not be found. Jun 03 10:04:39.360374 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:04:39.362359 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-6c22f4ee-7f26-4da9-8305-e7b0bf949f5c tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Returning 404 to user: Instance 7b4620df-63bb-4550-b854-4c81bb1219e0 could not be found. {{(pid=125065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:04:39.362359 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-6c22f4ee-7f26-4da9-8305-e7b0bf949f5c tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 404 len: 111 microversion: 2.1 time: 0.034626 Jun 03 10:04:39.368029 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 399/794] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:39 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:04:39.372361 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-a99cb48f-e1a7-4a6a-8557-4af879f3fbf7 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:39.373101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-a99cb48f-e1a7-4a6a-8557-4af879f3fbf7 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:39.387446 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a99cb48f-e1a7-4a6a-8557-4af879f3fbf7 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:39.387904 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a99cb48f-e1a7-4a6a-8557-4af879f3fbf7 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:39.389151 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a99cb48f-e1a7-4a6a-8557-4af879f3fbf7 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:39.389598 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a99cb48f-e1a7-4a6a-8557-4af879f3fbf7 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:39.405252 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-52915fec-ce1d-4110-87cf-672bf3f81de5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:39.416169 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-52915fec-ce1d-4110-87cf-672bf3f81de5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:39.417849 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-52915fec-ce1d-4110-87cf-672bf3f81de5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:39.419737 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-52915fec-ce1d-4110-87cf-672bf3f81de5 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1732 microversion: 2.20 time: 0.193256 Jun 03 10:04:39.420948 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 396/795] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:39 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1732 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:39.466072 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-e71dd884-a244-4a09-ab8c-3bc84688e5c5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2082065355", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1365846056", "security_groups": [{"name": "tempest-secgroup-smoke-921144121"}], "block_device_mapping_v2": [{"uuid": "b39a96c2-5db4-4e79-83a3-9de06e8fdc21", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cdd39ad8-1097-4745-8715-b421d9c9917f"}]}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:04:39.477102 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.objects.instance [None req-a99cb48f-e1a7-4a6a-8557-4af879f3fbf7 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lazy-loading 'services' on Instance uuid cbff6766-51d9-41a5-b9f9-bdb117cad35f {{(pid=125065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:04:39.480668 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:39.630153 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.network.neutron [None req-e71dd884-a244-4a09-ab8c-3bc84688e5c5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] validate_networks() for [('cdd39ad8-1097-4745-8715-b421d9c9917f', None, None, None, None, None)] {{(pid=125066) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 10:04:39.711818 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-a99cb48f-e1a7-4a6a-8557-4af879f3fbf7 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f/os-volume_attachments/b040aeb3-4746-42c1-b30e-2151f7168009" status: 202 len: 0 microversion: 2.1 time: 0.344307 Jun 03 10:04:39.712765 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 400/796] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jun 3 10:04:39 2022] DELETE /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f/os-volume_attachments/b040aeb3-4746-42c1-b30e-2151f7168009 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:04:40.017498 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-e71dd884-a244-4a09-ab8c-3bc84688e5c5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Flavor limits 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 10:04:40.017954 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-e71dd884-a244-4a09-ab8c-3bc84688e5c5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Image limits 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 10:04:40.018434 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-e71dd884-a244-4a09-ab8c-3bc84688e5c5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Flavor pref 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 10:04:40.018843 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-e71dd884-a244-4a09-ab8c-3bc84688e5c5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Image pref 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 10:04:40.019255 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-e71dd884-a244-4a09-ab8c-3bc84688e5c5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 10:04:40.029081 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e71dd884-a244-4a09-ab8c-3bc84688e5c5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:40.029535 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e71dd884-a244-4a09-ab8c-3bc84688e5c5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:40.030381 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e71dd884-a244-4a09-ab8c-3bc84688e5c5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:40.030910 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e71dd884-a244-4a09-ab8c-3bc84688e5c5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:40.047255 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-e71dd884-a244-4a09-ab8c-3bc84688e5c5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Getting quotas for project 5476f21b29944eb69e32a2d97b328aed. Resources: {'ram', 'instances', 'cores'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:04:40.051684 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-e71dd884-a244-4a09-ab8c-3bc84688e5c5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Getting quotas for user 646fecf4405c41a0bc062c6b54fd311c and project 5476f21b29944eb69e32a2d97b328aed. Resources: {'ram', 'instances', 'cores'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:04:40.106982 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-e71dd884-a244-4a09-ab8c-3bc84688e5c5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Going to run 1 instances... {{(pid=125066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 10:04:40.109141 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-e71dd884-a244-4a09-ab8c-3bc84688e5c5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: acca7e36-982b-4fc4-a4a6-8e34f7b25d7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b39a96c2-5db4-4e79-83a3-9de06e8fdc21',volume_size=None,volume_type=None)] {{(pid=125066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 10:04:40.439475 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-68ddccb2-6d13-4cb8-aa8f-684acaf70ecc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:40.440184 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-68ddccb2-6d13-4cb8-aa8f-684acaf70ecc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:40.447674 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-68ddccb2-6d13-4cb8-aa8f-684acaf70ecc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:40.448063 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-68ddccb2-6d13-4cb8-aa8f-684acaf70ecc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:40.448825 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-68ddccb2-6d13-4cb8-aa8f-684acaf70ecc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:40.449261 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-68ddccb2-6d13-4cb8-aa8f-684acaf70ecc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:40.503098 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-e71dd884-a244-4a09-ab8c-3bc84688e5c5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.040883 Jun 03 10:04:40.509185 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 397/797] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 3 10:04:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 1042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 03 10:04:40.514587 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-10cfee13-8aee-404a-b953-520fd180e710 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:40.515197 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-10cfee13-8aee-404a-b953-520fd180e710 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: acca7e36-982b-4fc4-a4a6-8e34f7b25d7a] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:40.588208 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-10cfee13-8aee-404a-b953-520fd180e710 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:40.601191 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-10cfee13-8aee-404a-b953-520fd180e710 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a" status: 200 len: 1095 microversion: 2.1 time: 0.090908 Jun 03 10:04:40.601856 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 398/798] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:40 2022] GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a => generated 1095 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:04:40.610589 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-68ddccb2-6d13-4cb8-aa8f-684acaf70ecc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:40.619176 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-68ddccb2-6d13-4cb8-aa8f-684acaf70ecc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:40.621037 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-68ddccb2-6d13-4cb8-aa8f-684acaf70ecc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:40.622443 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-68ddccb2-6d13-4cb8-aa8f-684acaf70ecc tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1732 microversion: 2.20 time: 0.187587 Jun 03 10:04:40.626390 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 401/799] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:40 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1732 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:04:41.618396 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-2e166ae4-3eef-4afd-a5bd-b628b5ed6053 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:41.619061 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-2e166ae4-3eef-4afd-a5bd-b628b5ed6053 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: acca7e36-982b-4fc4-a4a6-8e34f7b25d7a] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:41.625550 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2e166ae4-3eef-4afd-a5bd-b628b5ed6053 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:41.626033 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2e166ae4-3eef-4afd-a5bd-b628b5ed6053 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:41.626783 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2e166ae4-3eef-4afd-a5bd-b628b5ed6053 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:41.627224 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2e166ae4-3eef-4afd-a5bd-b628b5ed6053 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:41.642672 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-5abe1c64-6219-41b8-9de4-29087bbe5319 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:41.643877 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-5abe1c64-6219-41b8-9de4-29087bbe5319 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:41.650419 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5abe1c64-6219-41b8-9de4-29087bbe5319 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:41.654298 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5abe1c64-6219-41b8-9de4-29087bbe5319 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:41.654298 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5abe1c64-6219-41b8-9de4-29087bbe5319 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:41.654298 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5abe1c64-6219-41b8-9de4-29087bbe5319 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:41.703984 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-2e166ae4-3eef-4afd-a5bd-b628b5ed6053 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:41.709046 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-2e166ae4-3eef-4afd-a5bd-b628b5ed6053 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a" status: 200 len: 1137 microversion: 2.1 time: 0.094718 Jun 03 10:04:41.709828 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 399/800] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:41 2022] GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a => generated 1137 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:41.799848 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-5abe1c64-6219-41b8-9de4-29087bbe5319 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:41.808279 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-5abe1c64-6219-41b8-9de4-29087bbe5319 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:41.809932 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-5abe1c64-6219-41b8-9de4-29087bbe5319 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:41.811235 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-5abe1c64-6219-41b8-9de4-29087bbe5319 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1732 microversion: 2.20 time: 0.172671 Jun 03 10:04:41.811795 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 402/801] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:41 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:04:41.825336 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-9669e924-10e7-474e-9d31-63673367cf62 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:41.825825 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-9669e924-10e7-474e-9d31-63673367cf62 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 17b2f507-9340-486f-92ed-d249b5b78d78] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:41.832507 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9669e924-10e7-474e-9d31-63673367cf62 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:41.832952 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9669e924-10e7-474e-9d31-63673367cf62 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:41.833708 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9669e924-10e7-474e-9d31-63673367cf62 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:41.834168 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9669e924-10e7-474e-9d31-63673367cf62 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:41.856653 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-9669e924-10e7-474e-9d31-63673367cf62 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78/ips" status: 200 len: 149 microversion: 2.1 time: 0.035097 Jun 03 10:04:41.857221 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 400/802] 10.222.0.42 () {58 vars in 1247 bytes} [Fri Jun 3 10:04:41 2022] GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:04:41.925664 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-32a60a6c-baaf-4d15-8b37-f347f0969ada tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:41.929015 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-32a60a6c-baaf-4d15-8b37-f347f0969ada tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:41.932674 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-32a60a6c-baaf-4d15-8b37-f347f0969ada tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:41.933871 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-32a60a6c-baaf-4d15-8b37-f347f0969ada tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:41.934752 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-32a60a6c-baaf-4d15-8b37-f347f0969ada tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:41.935374 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-32a60a6c-baaf-4d15-8b37-f347f0969ada tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:41.969234 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-32a60a6c-baaf-4d15-8b37-f347f0969ada tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047915 Jun 03 10:04:41.969803 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 403/803] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 3 10:04:41 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 10:04:42.076305 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-69e01a2f-7d19-4ad9-bc0c-356d4eaf091d tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:42.079400 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-69e01a2f-7d19-4ad9-bc0c-356d4eaf091d tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:42.083431 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-69e01a2f-7d19-4ad9-bc0c-356d4eaf091d tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:42.083891 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-69e01a2f-7d19-4ad9-bc0c-356d4eaf091d tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:42.084644 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-69e01a2f-7d19-4ad9-bc0c-356d4eaf091d tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:42.085078 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-69e01a2f-7d19-4ad9-bc0c-356d4eaf091d tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:42.113336 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-69e01a2f-7d19-4ad9-bc0c-356d4eaf091d tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041055 Jun 03 10:04:42.113900 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 401/804] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 3 10:04:42 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 10:04:42.173547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-4500c81d-0d06-49a1-80d3-eae868523299 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:42.176613 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-4500c81d-0d06-49a1-80d3-eae868523299 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:42.181636 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4500c81d-0d06-49a1-80d3-eae868523299 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:42.182362 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4500c81d-0d06-49a1-80d3-eae868523299 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:42.183119 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4500c81d-0d06-49a1-80d3-eae868523299 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:42.183717 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4500c81d-0d06-49a1-80d3-eae868523299 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:42.209386 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-4500c81d-0d06-49a1-80d3-eae868523299 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Going to try to terminate instance {{(pid=125065) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:04:42.542133 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-4500c81d-0d06-49a1-80d3-eae868523299 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f" status: 204 len: 0 microversion: 2.1 time: 0.372519 Jun 03 10:04:42.542359 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 404/805] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 3 10:04:42 2022] DELETE /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:04:42.551214 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-b294c8b3-ed02-4efc-b506-a09362a6e4d9 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:42.551818 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-b294c8b3-ed02-4efc-b506-a09362a6e4d9 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:42.558306 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b294c8b3-ed02-4efc-b506-a09362a6e4d9 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:42.558766 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b294c8b3-ed02-4efc-b506-a09362a6e4d9 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:42.559805 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b294c8b3-ed02-4efc-b506-a09362a6e4d9 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:42.560090 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b294c8b3-ed02-4efc-b506-a09362a6e4d9 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:42.727258 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-907b2555-bc7b-486f-bc06-1e19bb444d16 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:42.728146 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-907b2555-bc7b-486f-bc06-1e19bb444d16 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: acca7e36-982b-4fc4-a4a6-8e34f7b25d7a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:42.735475 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-907b2555-bc7b-486f-bc06-1e19bb444d16 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:42.736035 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-907b2555-bc7b-486f-bc06-1e19bb444d16 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:42.736898 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-907b2555-bc7b-486f-bc06-1e19bb444d16 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:42.737340 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-907b2555-bc7b-486f-bc06-1e19bb444d16 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:42.925401 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-907b2555-bc7b-486f-bc06-1e19bb444d16 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:42.934525 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-907b2555-bc7b-486f-bc06-1e19bb444d16 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a" status: 200 len: 1211 microversion: 2.1 time: 0.211637 Jun 03 10:04:42.935183 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 405/806] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:42 2022] GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a => generated 1211 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:04:42.947995 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-cd5e679b-071d-4a9a-9539-d8d5a37d2589 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:42.948721 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-cd5e679b-071d-4a9a-9539-d8d5a37d2589 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:42.954821 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-cd5e679b-071d-4a9a-9539-d8d5a37d2589 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:42.955341 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-cd5e679b-071d-4a9a-9539-d8d5a37d2589 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:42.956671 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-cd5e679b-071d-4a9a-9539-d8d5a37d2589 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:42.957161 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-cd5e679b-071d-4a9a-9539-d8d5a37d2589 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:43.013615 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-b294c8b3-ed02-4efc-b506-a09362a6e4d9 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:43.021418 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-b294c8b3-ed02-4efc-b506-a09362a6e4d9 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f" status: 200 len: 1674 microversion: 2.1 time: 0.474519 Jun 03 10:04:43.022150 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 402/807] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:42 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f => generated 1674 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:43.148338 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-cd5e679b-071d-4a9a-9539-d8d5a37d2589 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:43.156329 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-cd5e679b-071d-4a9a-9539-d8d5a37d2589 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:43.157777 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-cd5e679b-071d-4a9a-9539-d8d5a37d2589 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:43.159469 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-cd5e679b-071d-4a9a-9539-d8d5a37d2589 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1719 microversion: 2.20 time: 0.223365 Jun 03 10:04:43.160026 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 406/808] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:42 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1719 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:43.591817 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-755471d6-7dc9-41a0-a2a5-bdbad3414cd4 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36329aa3-1fe5-4c8d-a62c-8b8c0d1e260b"}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:04:43.593177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-755471d6-7dc9-41a0-a2a5-bdbad3414cd4 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 17b2f507-9340-486f-92ed-d249b5b78d78] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:43.599716 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-755471d6-7dc9-41a0-a2a5-bdbad3414cd4 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:43.600166 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-755471d6-7dc9-41a0-a2a5-bdbad3414cd4 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:43.600944 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-755471d6-7dc9-41a0-a2a5-bdbad3414cd4 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:43.602166 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-755471d6-7dc9-41a0-a2a5-bdbad3414cd4 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:43.951746 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-a98ba9ef-278b-4726-b81c-1527bb1c6aef tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:43.952501 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-a98ba9ef-278b-4726-b81c-1527bb1c6aef tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: acca7e36-982b-4fc4-a4a6-8e34f7b25d7a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:43.959009 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a98ba9ef-278b-4726-b81c-1527bb1c6aef tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:43.959463 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a98ba9ef-278b-4726-b81c-1527bb1c6aef tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:43.960222 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a98ba9ef-278b-4726-b81c-1527bb1c6aef tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:43.960666 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a98ba9ef-278b-4726-b81c-1527bb1c6aef tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:44.125049 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-a98ba9ef-278b-4726-b81c-1527bb1c6aef tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:44.132318 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-a98ba9ef-278b-4726-b81c-1527bb1c6aef tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a" status: 200 len: 1278 microversion: 2.1 time: 0.184311 Jun 03 10:04:44.134187 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 407/809] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:43 2022] GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a => generated 1278 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:04:44.138690 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-cee17923-a367-4326-a133-6d30e1ee7dbc tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:44.139541 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-cee17923-a367-4326-a133-6d30e1ee7dbc tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:44.146821 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-cee17923-a367-4326-a133-6d30e1ee7dbc tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:44.147263 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-cee17923-a367-4326-a133-6d30e1ee7dbc tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:44.148031 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-cee17923-a367-4326-a133-6d30e1ee7dbc tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:44.148462 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-cee17923-a367-4326-a133-6d30e1ee7dbc tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:44.432795 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-cee17923-a367-4326-a133-6d30e1ee7dbc tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:44.441452 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-cee17923-a367-4326-a133-6d30e1ee7dbc tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f" status: 200 len: 1674 microversion: 2.1 time: 0.306061 Jun 03 10:04:44.451250 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 408/810] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:44 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f => generated 1674 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:44.968378 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-755471d6-7dc9-41a0-a2a5-bdbad3414cd4 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "POST /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.380316 Jun 03 10:04:44.973143 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 403/811] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jun 3 10:04:43 2022] POST /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78/os-volume_attachments => generated 194 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:04:45.149645 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-096d6ae0-5220-4e0a-983b-101a9d0274b8 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:45.150643 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-096d6ae0-5220-4e0a-983b-101a9d0274b8 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: acca7e36-982b-4fc4-a4a6-8e34f7b25d7a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:45.156873 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-096d6ae0-5220-4e0a-983b-101a9d0274b8 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:45.157323 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-096d6ae0-5220-4e0a-983b-101a9d0274b8 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:45.158119 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-096d6ae0-5220-4e0a-983b-101a9d0274b8 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:45.159283 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-096d6ae0-5220-4e0a-983b-101a9d0274b8 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:45.376408 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-096d6ae0-5220-4e0a-983b-101a9d0274b8 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:45.382824 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-096d6ae0-5220-4e0a-983b-101a9d0274b8 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a" status: 200 len: 1278 microversion: 2.1 time: 0.237131 Jun 03 10:04:45.383663 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 409/812] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:45 2022] GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a => generated 1278 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:45.462321 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-596bb9f8-ccf2-4d42-9407-0ab622736238 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:45.463306 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-596bb9f8-ccf2-4d42-9407-0ab622736238 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:45.469833 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-596bb9f8-ccf2-4d42-9407-0ab622736238 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:45.470583 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-596bb9f8-ccf2-4d42-9407-0ab622736238 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:45.471382 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-596bb9f8-ccf2-4d42-9407-0ab622736238 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:45.471853 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-596bb9f8-ccf2-4d42-9407-0ab622736238 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:45.480161 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-a225e6a0-f2a2-45ca-aa58-c46973196a42 req-f673953a-6f5f-49c8-942e-e4ba9dbef9f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acca7e36-982b-4fc4-a4a6-8e34f7b25d7a", "tag": "4bc88b77-b7fa-4b6a-90b4-2750b5baa1c9"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:04:45.491350 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-a225e6a0-f2a2-45ca-aa58-c46973196a42 req-f673953a-6f5f-49c8-942e-e4ba9dbef9f6 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:45.491350 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-a225e6a0-f2a2-45ca-aa58-c46973196a42 req-f673953a-6f5f-49c8-942e-e4ba9dbef9f6 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:45.501877 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-a225e6a0-f2a2-45ca-aa58-c46973196a42 req-f673953a-6f5f-49c8-942e-e4ba9dbef9f6 service nova] Creating event network-changed:4bc88b77-b7fa-4b6a-90b4-2750b5baa1c9 for instance acca7e36-982b-4fc4-a4a6-8e34f7b25d7a on hv-cinder-84456 Jun 03 10:04:45.508401 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-a225e6a0-f2a2-45ca-aa58-c46973196a42 req-f673953a-6f5f-49c8-942e-e4ba9dbef9f6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032270 Jun 03 10:04:45.510583 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 410/813] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:04:45.602418 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-596bb9f8-ccf2-4d42-9407-0ab622736238 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:45.612102 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-596bb9f8-ccf2-4d42-9407-0ab622736238 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f" status: 200 len: 1606 microversion: 2.1 time: 0.154547 Jun 03 10:04:45.613052 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 404/814] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:45 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f => generated 1606 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:46.029740 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-44263342-14f5-4d5f-9a8f-734e1b719e66 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:04:46.030395 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-44263342-14f5-4d5f-9a8f-734e1b719e66 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:46.037302 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-44263342-14f5-4d5f-9a8f-734e1b719e66 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:46.037756 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-44263342-14f5-4d5f-9a8f-734e1b719e66 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:46.038590 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-44263342-14f5-4d5f-9a8f-734e1b719e66 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:46.039017 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-44263342-14f5-4d5f-9a8f-734e1b719e66 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:46.064617 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.objects.instance [None req-44263342-14f5-4d5f-9a8f-734e1b719e66 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lazy-loading 'flavor' on Instance uuid 5afad0ea-b328-43cf-8ed2-f500796569b0 {{(pid=125065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:04:46.377059 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-44263342-14f5-4d5f-9a8f-734e1b719e66 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "POST /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0/action" status: 202 len: 0 microversion: 2.1 time: 0.351182 Jun 03 10:04:46.379582 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 411/815] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jun 3 10:04:46 2022] POST /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:04:46.390300 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-6f332ca2-dac2-4417-ad05-612b00bce2a9 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:46.391889 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-6f332ca2-dac2-4417-ad05-612b00bce2a9 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:46.401521 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6f332ca2-dac2-4417-ad05-612b00bce2a9 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:46.402201 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-251e68a6-10e7-4dd0-ad99-6c0c1b7fa9cc tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:46.402648 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6f332ca2-dac2-4417-ad05-612b00bce2a9 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:46.403350 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-251e68a6-10e7-4dd0-ad99-6c0c1b7fa9cc tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: acca7e36-982b-4fc4-a4a6-8e34f7b25d7a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:46.403978 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6f332ca2-dac2-4417-ad05-612b00bce2a9 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:46.404623 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6f332ca2-dac2-4417-ad05-612b00bce2a9 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:46.414833 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-251e68a6-10e7-4dd0-ad99-6c0c1b7fa9cc tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:46.415830 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-251e68a6-10e7-4dd0-ad99-6c0c1b7fa9cc tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:46.417129 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-251e68a6-10e7-4dd0-ad99-6c0c1b7fa9cc tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:46.418265 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-251e68a6-10e7-4dd0-ad99-6c0c1b7fa9cc tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:46.613363 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-6f332ca2-dac2-4417-ad05-612b00bce2a9 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:46.617308 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:46.623797 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-6f332ca2-dac2-4417-ad05-612b00bce2a9 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1568 microversion: 2.1 time: 0.238108 Jun 03 10:04:46.624907 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 405/816] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:46 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:46.628972 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-251e68a6-10e7-4dd0-ad99-6c0c1b7fa9cc tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:46.630770 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-7737f838-19bc-4fd6-96c9-fb552b13be32 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:46.631570 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-7737f838-19bc-4fd6-96c9-fb552b13be32 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:46.637598 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-251e68a6-10e7-4dd0-ad99-6c0c1b7fa9cc tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a" status: 200 len: 1266 microversion: 2.1 time: 0.240646 Jun 03 10:04:46.638254 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 412/817] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:46 2022] GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:46.638463 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7737f838-19bc-4fd6-96c9-fb552b13be32 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:46.639057 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7737f838-19bc-4fd6-96c9-fb552b13be32 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:46.640036 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7737f838-19bc-4fd6-96c9-fb552b13be32 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:46.640479 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7737f838-19bc-4fd6-96c9-fb552b13be32 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:46.672786 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7737f838-19bc-4fd6-96c9-fb552b13be32 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:46.673090 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7737f838-19bc-4fd6-96c9-fb552b13be32 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:46.673554 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.objects.instance [None req-7737f838-19bc-4fd6-96c9-fb552b13be32 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lazy-loading 'fault' on Instance uuid cbff6766-51d9-41a5-b9f9-bdb117cad35f {{(pid=125066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:04:46.717335 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-7737f838-19bc-4fd6-96c9-fb552b13be32 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49efae911ef8458b9288558014217934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '686f552be5824c8aa31930a6e8844255', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:46.724398 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-7737f838-19bc-4fd6-96c9-fb552b13be32 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f" status: 200 len: 1327 microversion: 2.1 time: 0.098367 Jun 03 10:04:46.724989 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 406/818] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:46 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f => generated 1327 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:47.526723 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-490a2694-5146-4459-b025-d840b73f1d74 req-945ffbeb-53c5-4afe-a30d-e09b1aabc750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbff6766-51d9-41a5-b9f9-bdb117cad35f", "name": "network-vif-deleted", "tag": "13121560-48ad-4ce7-91f1-cace26c579e9"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:04:47.530704 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:47.536428 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-490a2694-5146-4459-b025-d840b73f1d74 req-945ffbeb-53c5-4afe-a30d-e09b1aabc750 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:47.536867 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-490a2694-5146-4459-b025-d840b73f1d74 req-945ffbeb-53c5-4afe-a30d-e09b1aabc750 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:47.547746 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-490a2694-5146-4459-b025-d840b73f1d74 req-945ffbeb-53c5-4afe-a30d-e09b1aabc750 service nova] Creating event network-vif-deleted:13121560-48ad-4ce7-91f1-cace26c579e9 for instance cbff6766-51d9-41a5-b9f9-bdb117cad35f on hv-cinder-84456 Jun 03 10:04:47.552462 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-490a2694-5146-4459-b025-d840b73f1d74 req-945ffbeb-53c5-4afe-a30d-e09b1aabc750 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029435 Jun 03 10:04:47.553024 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 413/819] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:04:47.642457 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-4c1b7b08-c1c2-449a-bd73-eb82ea4a8a63 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:47.643743 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-4c1b7b08-c1c2-449a-bd73-eb82ea4a8a63 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:47.650293 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4c1b7b08-c1c2-449a-bd73-eb82ea4a8a63 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:47.650742 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4c1b7b08-c1c2-449a-bd73-eb82ea4a8a63 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:47.651497 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4c1b7b08-c1c2-449a-bd73-eb82ea4a8a63 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:47.651932 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4c1b7b08-c1c2-449a-bd73-eb82ea4a8a63 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:47.660923 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-26b09f67-c3f2-460b-ad04-980e1ebfd5db tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:47.661619 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-26b09f67-c3f2-460b-ad04-980e1ebfd5db tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: acca7e36-982b-4fc4-a4a6-8e34f7b25d7a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:47.668212 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-26b09f67-c3f2-460b-ad04-980e1ebfd5db tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:47.668664 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-26b09f67-c3f2-460b-ad04-980e1ebfd5db tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:47.669423 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-26b09f67-c3f2-460b-ad04-980e1ebfd5db tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:47.669863 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-26b09f67-c3f2-460b-ad04-980e1ebfd5db tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:47.847068 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-4c1b7b08-c1c2-449a-bd73-eb82ea4a8a63 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:47.854810 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-4c1b7b08-c1c2-449a-bd73-eb82ea4a8a63 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1568 microversion: 2.1 time: 0.216593 Jun 03 10:04:47.855384 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 407/820] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:47 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1568 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:47.855640 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-26b09f67-c3f2-460b-ad04-980e1ebfd5db tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:47.859136 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:47.860084 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-fc0390f7-10fb-4c33-b2e2-b64446ab6bf0 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:47.860695 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-fc0390f7-10fb-4c33-b2e2-b64446ab6bf0 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:47.863976 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-26b09f67-c3f2-460b-ad04-980e1ebfd5db tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a" status: 200 len: 1266 microversion: 2.1 time: 0.207575 Jun 03 10:04:47.864704 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 414/821] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:47 2022] GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:04:47.866803 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fc0390f7-10fb-4c33-b2e2-b64446ab6bf0 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:47.867259 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fc0390f7-10fb-4c33-b2e2-b64446ab6bf0 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:47.868027 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fc0390f7-10fb-4c33-b2e2-b64446ab6bf0 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:47.868465 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fc0390f7-10fb-4c33-b2e2-b64446ab6bf0 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:47.884245 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.wsgi [None req-fc0390f7-10fb-4c33-b2e2-b64446ab6bf0 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] HTTP exception thrown: Instance cbff6766-51d9-41a5-b9f9-bdb117cad35f could not be found. Jun 03 10:04:47.885902 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-fc0390f7-10fb-4c33-b2e2-b64446ab6bf0 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Request method failure captured: Jun 03 10:04:47.885902 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: request: GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f HTTP/1.1 Jun 03 10:04:47.885902 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept: application/json Jun 03 10:04:47.885902 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept-Encoding: identity Jun 03 10:04:47.885902 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Connection: close Jun 03 10:04:47.885902 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Length: 0 Jun 03 10:04:47.885902 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Type: application/json Jun 03 10:04:47.885902 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Host: 10.222.0.42 Jun 03 10:04:47.885902 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Openstack-System-Scope: None Jun 03 10:04:47.885902 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: User-Agent: python-urllib3/1.26.9 Jun 03 10:04:47.885902 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Auth-Token: gAAAAABimdtBMxI1_XARv6zROzpVvCk5TBiT12tdRbdOvk6wC3oEf1-r8UmrTZdYHxthXgJhwuyEo3PRevUOlHG2OvaZyxBk3IoOTJn-eXtqweY8QkNyg2GJrJmEcGTYbKMr9Rbr20vV9fu-8zaHcMKp5wE--6uSFsvysYsmZl5fOZlY92hSGXA Jun 03 10:04:47.885902 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Id: None Jun 03 10:04:47.885902 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Name: None Jun 03 10:04:47.885902 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Identity-Status: Confirmed Jun 03 10:04:47.885902 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Is-Admin-Project: True Jun 03 10:04:47.885902 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Id: default Jun 03 10:04:47.885902 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Name: Default Jun 03 10:04:47.885902 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Id: 686f552be5824c8aa31930a6e8844255 Jun 03 10:04:47.885902 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Name: tempest-AttachVolumeTestJSON-145001499 Jun 03 10:04:47.885902 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Role: member,reader Jun 03 10:04:47.885902 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Roles: member,reader Jun 03 10:04:47.887465 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/686f552be5824c8aa31930a6e8844255"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/686f552be5824c8aa31930a6e8844255"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_686f552be5824c8aa31930a6e8844255", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/686f552be5824c8aa31930a6e8844255"}]}] Jun 03 10:04:47.887465 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant: tempest-AttachVolumeTestJSON-145001499 Jun 03 10:04:47.887465 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Id: 686f552be5824c8aa31930a6e8844255 Jun 03 10:04:47.887465 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Name: tempest-AttachVolumeTestJSON-145001499 Jun 03 10:04:47.887465 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User: tempest-AttachVolumeTestJSON-145001499-project Jun 03 10:04:47.887465 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Id: default Jun 03 10:04:47.887465 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Name: Default Jun 03 10:04:47.887465 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Id: 49efae911ef8458b9288558014217934 Jun 03 10:04:47.887465 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Name: tempest-AttachVolumeTestJSON-145001499-project Jun 03 10:04:47.887465 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: method: > Jun 03 10:04:47.887465 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: exception: Instance cbff6766-51d9-41a5-b9f9-bdb117cad35f could not be found. Jun 03 10:04:47.887465 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: action_args: {'id': 'cbff6766-51d9-41a5-b9f9-bdb117cad35f'} Jun 03 10:04:47.888367 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:04:47.888367 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:04:47.888367 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:04:47.888367 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:04:47.888367 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:04:47.888367 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:04:47.888367 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:04:47.888367 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:04:47.888367 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:04:47.888367 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:04:47.888367 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbff6766-51d9-41a5-b9f9-bdb117cad35f could not be found. Jun 03 10:04:47.888367 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:04:47.888367 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:04:47.888367 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:04:47.888367 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:04:47.888367 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:04:47.888367 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:04:47.888367 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:04:47.888367 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:04:47.888367 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:04:47.889810 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:04:47.889810 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:04:47.889810 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:04:47.889810 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:04:47.889810 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:04:47.889810 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:04:47.889810 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:04:47.889810 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbff6766-51d9-41a5-b9f9-bdb117cad35f could not be found. Jun 03 10:04:47.889810 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:04:47.889810 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:04:47.889810 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:04:47.889810 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:04:47.889810 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:04:47.889810 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:04:47.889810 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:04:47.889810 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:04:47.889810 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbff6766-51d9-41a5-b9f9-bdb117cad35f could not be found. Jun 03 10:04:47.889810 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:04:47.891532 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-fc0390f7-10fb-4c33-b2e2-b64446ab6bf0 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Returning 404 to user: Instance cbff6766-51d9-41a5-b9f9-bdb117cad35f could not be found. {{(pid=125066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:04:47.891532 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-fc0390f7-10fb-4c33-b2e2-b64446ab6bf0 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f" status: 404 len: 111 microversion: 2.1 time: 0.031032 Jun 03 10:04:47.891532 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 408/822] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:47 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:04:47.897174 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-2af0d96f-fd3e-4517-ab10-79ac32c53a59 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '.version_select at 0x7f8d236c2e50>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:47.993492 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-2af0d96f-fd3e-4517-ab10-79ac32c53a59 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-712776769" status: 202 len: 0 microversion: 2.1 time: 0.100963 Jun 03 10:04:47.994111 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 415/823] 10.222.0.42 () {58 vars in 1217 bytes} [Fri Jun 3 10:04:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-712776769 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:04:48.872423 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-aa37aed5-5609-4df8-b667-60d2f55d64ff tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:48.873053 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-aa37aed5-5609-4df8-b667-60d2f55d64ff tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:48.880129 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-aa37aed5-5609-4df8-b667-60d2f55d64ff tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:48.880568 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-aa37aed5-5609-4df8-b667-60d2f55d64ff tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:48.881414 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-e6ac3686-9515-4eeb-85a7-11a352a941f5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:48.881905 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-aa37aed5-5609-4df8-b667-60d2f55d64ff tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:48.881905 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-aa37aed5-5609-4df8-b667-60d2f55d64ff tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:48.882242 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-e6ac3686-9515-4eeb-85a7-11a352a941f5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: acca7e36-982b-4fc4-a4a6-8e34f7b25d7a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:48.894538 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e6ac3686-9515-4eeb-85a7-11a352a941f5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:48.895740 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e6ac3686-9515-4eeb-85a7-11a352a941f5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:48.896643 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e6ac3686-9515-4eeb-85a7-11a352a941f5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:48.897438 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e6ac3686-9515-4eeb-85a7-11a352a941f5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:49.045560 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-aa37aed5-5609-4df8-b667-60d2f55d64ff tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:49.054720 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-aa37aed5-5609-4df8-b667-60d2f55d64ff tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1568 microversion: 2.1 time: 0.186014 Jun 03 10:04:49.055711 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 409/824] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:48 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:49.196867 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-e6ac3686-9515-4eeb-85a7-11a352a941f5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:49.204412 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-e6ac3686-9515-4eeb-85a7-11a352a941f5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a" status: 200 len: 1266 microversion: 2.1 time: 0.327700 Jun 03 10:04:49.204980 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 416/825] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:48 2022] GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a => generated 1266 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:04:50.072433 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-e035bf54-f1ec-4dea-a206-383b7b0f1863 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:50.073187 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-e035bf54-f1ec-4dea-a206-383b7b0f1863 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:50.075577 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell0:SELECT=2 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:50.076252 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:50.080957 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e035bf54-f1ec-4dea-a206-383b7b0f1863 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:50.081404 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e035bf54-f1ec-4dea-a206-383b7b0f1863 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:50.082232 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e035bf54-f1ec-4dea-a206-383b7b0f1863 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:50.082674 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e035bf54-f1ec-4dea-a206-383b7b0f1863 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:50.222584 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-e696f69a-e83f-4ec9-b505-9e86565e0f55 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:50.223275 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-e696f69a-e83f-4ec9-b505-9e86565e0f55 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: acca7e36-982b-4fc4-a4a6-8e34f7b25d7a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:50.230153 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-e035bf54-f1ec-4dea-a206-383b7b0f1863 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:50.231124 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e696f69a-e83f-4ec9-b505-9e86565e0f55 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:50.231575 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e696f69a-e83f-4ec9-b505-9e86565e0f55 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:50.232791 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e696f69a-e83f-4ec9-b505-9e86565e0f55 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:50.233384 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e696f69a-e83f-4ec9-b505-9e86565e0f55 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:50.237301 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-e035bf54-f1ec-4dea-a206-383b7b0f1863 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1568 microversion: 2.1 time: 0.168665 Jun 03 10:04:50.237870 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 410/826] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:50 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:50.366313 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-e696f69a-e83f-4ec9-b505-9e86565e0f55 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:50.373867 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-e696f69a-e83f-4ec9-b505-9e86565e0f55 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a" status: 200 len: 1266 microversion: 2.1 time: 0.155901 Jun 03 10:04:50.374444 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 417/827] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:50 2022] GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:51.255533 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-bcf5193c-705b-4cfb-b3a1-a7f6ce6ffb5b tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:51.256218 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-bcf5193c-705b-4cfb-b3a1-a7f6ce6ffb5b tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:51.258485 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell0:SELECT=8 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:51.263563 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-2cc6df19-f2f3-49c3-a49b-149bffe29a4b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:51.271407 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-2cc6df19-f2f3-49c3-a49b-149bffe29a4b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:51.271532 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bcf5193c-705b-4cfb-b3a1-a7f6ce6ffb5b tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:51.271532 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bcf5193c-705b-4cfb-b3a1-a7f6ce6ffb5b tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:51.271532 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bcf5193c-705b-4cfb-b3a1-a7f6ce6ffb5b tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:51.271532 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bcf5193c-705b-4cfb-b3a1-a7f6ce6ffb5b tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:51.271832 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2cc6df19-f2f3-49c3-a49b-149bffe29a4b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:51.271832 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2cc6df19-f2f3-49c3-a49b-149bffe29a4b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:51.271832 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2cc6df19-f2f3-49c3-a49b-149bffe29a4b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:51.272048 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2cc6df19-f2f3-49c3-a49b-149bffe29a4b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:51.286862 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.wsgi [None req-2cc6df19-f2f3-49c3-a49b-149bffe29a4b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] HTTP exception thrown: Instance cbff6766-51d9-41a5-b9f9-bdb117cad35f could not be found. Jun 03 10:04:51.288496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-2cc6df19-f2f3-49c3-a49b-149bffe29a4b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Request method failure captured: Jun 03 10:04:51.288496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: request: DELETE /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f HTTP/1.1 Jun 03 10:04:51.288496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept: application/json Jun 03 10:04:51.288496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept-Encoding: identity Jun 03 10:04:51.288496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Connection: close Jun 03 10:04:51.288496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Length: 0 Jun 03 10:04:51.288496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Type: application/json Jun 03 10:04:51.288496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Host: 10.222.0.42 Jun 03 10:04:51.288496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Openstack-System-Scope: None Jun 03 10:04:51.288496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: User-Agent: python-urllib3/1.26.9 Jun 03 10:04:51.288496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Auth-Token: gAAAAABimdtBMxI1_XARv6zROzpVvCk5TBiT12tdRbdOvk6wC3oEf1-r8UmrTZdYHxthXgJhwuyEo3PRevUOlHG2OvaZyxBk3IoOTJn-eXtqweY8QkNyg2GJrJmEcGTYbKMr9Rbr20vV9fu-8zaHcMKp5wE--6uSFsvysYsmZl5fOZlY92hSGXA Jun 03 10:04:51.288496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Id: None Jun 03 10:04:51.288496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Name: None Jun 03 10:04:51.288496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Identity-Status: Confirmed Jun 03 10:04:51.288496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Is-Admin-Project: True Jun 03 10:04:51.288496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Id: default Jun 03 10:04:51.288496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Name: Default Jun 03 10:04:51.288496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Id: 686f552be5824c8aa31930a6e8844255 Jun 03 10:04:51.288496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Name: tempest-AttachVolumeTestJSON-145001499 Jun 03 10:04:51.288496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Role: member,reader Jun 03 10:04:51.288496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Roles: member,reader Jun 03 10:04:51.289809 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/686f552be5824c8aa31930a6e8844255"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/686f552be5824c8aa31930a6e8844255"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_686f552be5824c8aa31930a6e8844255", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/686f552be5824c8aa31930a6e8844255"}]}] Jun 03 10:04:51.289809 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant: tempest-AttachVolumeTestJSON-145001499 Jun 03 10:04:51.289809 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Id: 686f552be5824c8aa31930a6e8844255 Jun 03 10:04:51.289809 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Name: tempest-AttachVolumeTestJSON-145001499 Jun 03 10:04:51.289809 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User: tempest-AttachVolumeTestJSON-145001499-project Jun 03 10:04:51.289809 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Id: default Jun 03 10:04:51.289809 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Name: Default Jun 03 10:04:51.289809 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Id: 49efae911ef8458b9288558014217934 Jun 03 10:04:51.289809 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Name: tempest-AttachVolumeTestJSON-145001499-project Jun 03 10:04:51.289809 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: method: > Jun 03 10:04:51.289809 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: exception: Instance cbff6766-51d9-41a5-b9f9-bdb117cad35f could not be found. Jun 03 10:04:51.289809 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: action_args: {'id': 'cbff6766-51d9-41a5-b9f9-bdb117cad35f'} Jun 03 10:04:51.290774 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:04:51.290774 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:04:51.290774 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:04:51.290774 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:04:51.290774 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:04:51.290774 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:04:51.290774 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:04:51.290774 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:04:51.290774 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:04:51.290774 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:04:51.290774 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbff6766-51d9-41a5-b9f9-bdb117cad35f could not be found. Jun 03 10:04:51.290774 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:04:51.290774 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:04:51.290774 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:04:51.290774 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:04:51.290774 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:04:51.290774 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:04:51.290774 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:04:51.290774 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:04:51.290774 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:04:51.291953 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:04:51.291953 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 10:04:51.291953 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 10:04:51.291953 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 10:04:51.291953 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 10:04:51.291953 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:04:51.291953 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:04:51.291953 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:04:51.291953 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:04:51.291953 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbff6766-51d9-41a5-b9f9-bdb117cad35f could not be found. Jun 03 10:04:51.291953 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:04:51.291953 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:04:51.291953 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:04:51.291953 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:04:51.291953 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:04:51.291953 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:04:51.291953 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:04:51.291953 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:04:51.291953 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbff6766-51d9-41a5-b9f9-bdb117cad35f could not be found. Jun 03 10:04:51.291953 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:04:51.293251 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-2cc6df19-f2f3-49c3-a49b-149bffe29a4b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Returning 404 to user: Instance cbff6766-51d9-41a5-b9f9-bdb117cad35f could not be found. {{(pid=125065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:04:51.293251 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-2cc6df19-f2f3-49c3-a49b-149bffe29a4b tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f" status: 404 len: 111 microversion: 2.1 time: 0.030396 Jun 03 10:04:51.293251 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 418/828] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 3 10:04:51 2022] DELETE /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 10:04:51.298096 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-49f4305d-b4e3-48c3-8917-01ba7fc1fe26 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:51.298735 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-49f4305d-b4e3-48c3-8917-01ba7fc1fe26 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: cbff6766-51d9-41a5-b9f9-bdb117cad35f] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:51.305331 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-49f4305d-b4e3-48c3-8917-01ba7fc1fe26 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:51.305775 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-49f4305d-b4e3-48c3-8917-01ba7fc1fe26 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:51.307785 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-49f4305d-b4e3-48c3-8917-01ba7fc1fe26 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:51.307785 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-49f4305d-b4e3-48c3-8917-01ba7fc1fe26 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:51.322473 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.wsgi [None req-49f4305d-b4e3-48c3-8917-01ba7fc1fe26 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] HTTP exception thrown: Instance cbff6766-51d9-41a5-b9f9-bdb117cad35f could not be found. Jun 03 10:04:51.324287 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-49f4305d-b4e3-48c3-8917-01ba7fc1fe26 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Request method failure captured: Jun 03 10:04:51.324287 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: request: GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f HTTP/1.1 Jun 03 10:04:51.324287 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept: application/json Jun 03 10:04:51.324287 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept-Encoding: identity Jun 03 10:04:51.324287 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Connection: close Jun 03 10:04:51.324287 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Length: 0 Jun 03 10:04:51.324287 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Type: application/json Jun 03 10:04:51.324287 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Host: 10.222.0.42 Jun 03 10:04:51.324287 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Openstack-System-Scope: None Jun 03 10:04:51.324287 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: User-Agent: python-urllib3/1.26.9 Jun 03 10:04:51.324287 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Auth-Token: gAAAAABimdtBMxI1_XARv6zROzpVvCk5TBiT12tdRbdOvk6wC3oEf1-r8UmrTZdYHxthXgJhwuyEo3PRevUOlHG2OvaZyxBk3IoOTJn-eXtqweY8QkNyg2GJrJmEcGTYbKMr9Rbr20vV9fu-8zaHcMKp5wE--6uSFsvysYsmZl5fOZlY92hSGXA Jun 03 10:04:51.324287 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Id: None Jun 03 10:04:51.324287 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Name: None Jun 03 10:04:51.324287 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Identity-Status: Confirmed Jun 03 10:04:51.324287 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Is-Admin-Project: True Jun 03 10:04:51.324287 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Id: default Jun 03 10:04:51.324287 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Name: Default Jun 03 10:04:51.324287 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Id: 686f552be5824c8aa31930a6e8844255 Jun 03 10:04:51.324287 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Name: tempest-AttachVolumeTestJSON-145001499 Jun 03 10:04:51.324287 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Role: member,reader Jun 03 10:04:51.324287 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Roles: member,reader Jun 03 10:04:51.329976 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/686f552be5824c8aa31930a6e8844255"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/686f552be5824c8aa31930a6e8844255"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_686f552be5824c8aa31930a6e8844255", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/686f552be5824c8aa31930a6e8844255"}]}] Jun 03 10:04:51.329976 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant: tempest-AttachVolumeTestJSON-145001499 Jun 03 10:04:51.329976 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Id: 686f552be5824c8aa31930a6e8844255 Jun 03 10:04:51.329976 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Name: tempest-AttachVolumeTestJSON-145001499 Jun 03 10:04:51.329976 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User: tempest-AttachVolumeTestJSON-145001499-project Jun 03 10:04:51.329976 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Id: default Jun 03 10:04:51.329976 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Name: Default Jun 03 10:04:51.329976 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Id: 49efae911ef8458b9288558014217934 Jun 03 10:04:51.329976 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Name: tempest-AttachVolumeTestJSON-145001499-project Jun 03 10:04:51.329976 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: method: > Jun 03 10:04:51.329976 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: exception: Instance cbff6766-51d9-41a5-b9f9-bdb117cad35f could not be found. Jun 03 10:04:51.329976 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: action_args: {'id': 'cbff6766-51d9-41a5-b9f9-bdb117cad35f'} Jun 03 10:04:51.330713 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:04:51.330713 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:04:51.330713 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:04:51.330713 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:04:51.330713 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:04:51.330713 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:04:51.330713 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:04:51.330713 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:04:51.330713 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:04:51.330713 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:04:51.330713 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbff6766-51d9-41a5-b9f9-bdb117cad35f could not be found. Jun 03 10:04:51.330713 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:04:51.330713 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:04:51.330713 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:04:51.330713 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:04:51.330713 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:04:51.330713 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:04:51.330713 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:04:51.330713 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:04:51.330713 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:04:51.331893 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:04:51.331893 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:04:51.331893 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:04:51.331893 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:04:51.331893 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:04:51.331893 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:04:51.331893 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:04:51.331893 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbff6766-51d9-41a5-b9f9-bdb117cad35f could not be found. Jun 03 10:04:51.331893 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:04:51.331893 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:04:51.331893 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:04:51.331893 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:04:51.331893 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:04:51.331893 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:04:51.331893 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:04:51.331893 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:04:51.331893 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbff6766-51d9-41a5-b9f9-bdb117cad35f could not be found. Jun 03 10:04:51.331893 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:04:51.333463 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-49f4305d-b4e3-48c3-8917-01ba7fc1fe26 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Returning 404 to user: Instance cbff6766-51d9-41a5-b9f9-bdb117cad35f could not be found. {{(pid=125065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:04:51.333463 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-49f4305d-b4e3-48c3-8917-01ba7fc1fe26 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f" status: 404 len: 111 microversion: 2.1 time: 0.031208 Jun 03 10:04:51.333463 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 419/829] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:51 2022] GET /compute/v2.1/servers/cbff6766-51d9-41a5-b9f9-bdb117cad35f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 10:04:51.390915 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-d09c8efb-0135-44c3-b44e-66b548600b9a tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:51.391737 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-d09c8efb-0135-44c3-b44e-66b548600b9a tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: acca7e36-982b-4fc4-a4a6-8e34f7b25d7a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:51.398343 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d09c8efb-0135-44c3-b44e-66b548600b9a tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:51.398948 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d09c8efb-0135-44c3-b44e-66b548600b9a tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:51.400037 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d09c8efb-0135-44c3-b44e-66b548600b9a tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:51.400610 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d09c8efb-0135-44c3-b44e-66b548600b9a tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:51.422532 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-bcf5193c-705b-4cfb-b3a1-a7f6ce6ffb5b tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:51.430886 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-bcf5193c-705b-4cfb-b3a1-a7f6ce6ffb5b tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1568 microversion: 2.1 time: 0.180435 Jun 03 10:04:51.431539 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 411/830] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:51 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:51.537296 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-d09c8efb-0135-44c3-b44e-66b548600b9a tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:51.545180 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-d09c8efb-0135-44c3-b44e-66b548600b9a tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a" status: 200 len: 1266 microversion: 2.1 time: 0.157972 Jun 03 10:04:51.545741 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 420/831] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:51 2022] GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:52.447236 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-a3d1e6eb-32d1-4b20-82fe-bc8f1af97cde tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:52.447842 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-a3d1e6eb-32d1-4b20-82fe-bc8f1af97cde tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:52.454392 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a3d1e6eb-32d1-4b20-82fe-bc8f1af97cde tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:52.454838 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a3d1e6eb-32d1-4b20-82fe-bc8f1af97cde tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:52.455665 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a3d1e6eb-32d1-4b20-82fe-bc8f1af97cde tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:52.456099 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a3d1e6eb-32d1-4b20-82fe-bc8f1af97cde tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:52.520639 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-e8acddd5-6be8-4d7a-8492-b3c2f5859c0b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Action: 'create', calling method: .version_select at 0x7f8d3516c1f0>, body: {"keypair": {"name": "tempest-keypair-1253900515", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOR+CAcViG1cSIevCra5M33Zau/ZJGXRldlxT5wsuH3CwSvt92DKH9t08iFP9VhkNXVL4Ue1/+hlf+6R6CorKpEogrMs/bcKP57wfx1DRgVJA/eCPOqp4GvLW6BpYLy04g=="}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:04:52.535266 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.quota [None req-e8acddd5-6be8-4d7a-8492-b3c2f5859c0b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Getting quotas for project 3e51010dd5d84daf8aa43859e9e7cb6d. Resources: {'key_pairs'} {{(pid=125065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:04:52.540266 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.quota [None req-e8acddd5-6be8-4d7a-8492-b3c2f5859c0b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Getting quotas for user ce77221a2c8d4c4395bed092c1967b28 and project 3e51010dd5d84daf8aa43859e9e7cb6d. Resources: {'key_pairs'} {{(pid=125065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:04:52.590887 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-a3d1e6eb-32d1-4b20-82fe-bc8f1af97cde tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:52.599035 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-a3d1e6eb-32d1-4b20-82fe-bc8f1af97cde tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1568 microversion: 2.1 time: 0.155592 Jun 03 10:04:52.599607 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 412/832] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:52 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:52.604008 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-d49c00f3-f027-42ba-a8c1-9ba79f3eb840 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:52.604609 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-d49c00f3-f027-42ba-a8c1-9ba79f3eb840 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: acca7e36-982b-4fc4-a4a6-8e34f7b25d7a] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:52.610566 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d49c00f3-f027-42ba-a8c1-9ba79f3eb840 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:52.611010 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d49c00f3-f027-42ba-a8c1-9ba79f3eb840 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:52.612290 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d49c00f3-f027-42ba-a8c1-9ba79f3eb840 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:52.612751 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d49c00f3-f027-42ba-a8c1-9ba79f3eb840 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:52.657689 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-e8acddd5-6be8-4d7a-8492-b3c2f5859c0b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.140820 Jun 03 10:04:52.658823 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 421/833] 10.222.0.42 () {60 vars in 1158 bytes} [Fri Jun 3 10:04:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:04:52.663614 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-b24d55b6-003a-46dc-9a93-398c9ca58679 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:52.664052 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-b24d55b6-003a-46dc-9a93-398c9ca58679 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:52.670767 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b24d55b6-003a-46dc-9a93-398c9ca58679 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:52.671324 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b24d55b6-003a-46dc-9a93-398c9ca58679 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:52.672174 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b24d55b6-003a-46dc-9a93-398c9ca58679 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:52.672688 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b24d55b6-003a-46dc-9a93-398c9ca58679 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:52.687824 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.wsgi [None req-b24d55b6-003a-46dc-9a93-398c9ca58679 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] HTTP exception thrown: Instance 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 could not be found. Jun 03 10:04:52.689504 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-b24d55b6-003a-46dc-9a93-398c9ca58679 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Request method failure captured: Jun 03 10:04:52.689504 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: request: DELETE /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 HTTP/1.1 Jun 03 10:04:52.689504 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept: application/json Jun 03 10:04:52.689504 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept-Encoding: identity Jun 03 10:04:52.689504 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Connection: close Jun 03 10:04:52.689504 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Length: 0 Jun 03 10:04:52.689504 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Type: application/json Jun 03 10:04:52.689504 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Host: 10.222.0.42 Jun 03 10:04:52.689504 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Openstack-System-Scope: None Jun 03 10:04:52.689504 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: User-Agent: python-urllib3/1.26.9 Jun 03 10:04:52.689504 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Auth-Token: gAAAAABimdtBMxI1_XARv6zROzpVvCk5TBiT12tdRbdOvk6wC3oEf1-r8UmrTZdYHxthXgJhwuyEo3PRevUOlHG2OvaZyxBk3IoOTJn-eXtqweY8QkNyg2GJrJmEcGTYbKMr9Rbr20vV9fu-8zaHcMKp5wE--6uSFsvysYsmZl5fOZlY92hSGXA Jun 03 10:04:52.689504 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Id: None Jun 03 10:04:52.689504 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Name: None Jun 03 10:04:52.689504 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Identity-Status: Confirmed Jun 03 10:04:52.689504 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Is-Admin-Project: True Jun 03 10:04:52.689504 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Id: default Jun 03 10:04:52.689504 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Name: Default Jun 03 10:04:52.689504 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Id: 686f552be5824c8aa31930a6e8844255 Jun 03 10:04:52.689504 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Name: tempest-AttachVolumeTestJSON-145001499 Jun 03 10:04:52.689504 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Role: member,reader Jun 03 10:04:52.689504 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Roles: member,reader Jun 03 10:04:52.691671 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/686f552be5824c8aa31930a6e8844255"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/686f552be5824c8aa31930a6e8844255"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_686f552be5824c8aa31930a6e8844255", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/686f552be5824c8aa31930a6e8844255"}]}] Jun 03 10:04:52.691671 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant: tempest-AttachVolumeTestJSON-145001499 Jun 03 10:04:52.691671 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Id: 686f552be5824c8aa31930a6e8844255 Jun 03 10:04:52.691671 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Name: tempest-AttachVolumeTestJSON-145001499 Jun 03 10:04:52.691671 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User: tempest-AttachVolumeTestJSON-145001499-project Jun 03 10:04:52.691671 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Id: default Jun 03 10:04:52.691671 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Name: Default Jun 03 10:04:52.691671 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Id: 49efae911ef8458b9288558014217934 Jun 03 10:04:52.691671 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Name: tempest-AttachVolumeTestJSON-145001499-project Jun 03 10:04:52.691671 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: method: > Jun 03 10:04:52.691671 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: exception: Instance 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 could not be found. Jun 03 10:04:52.691671 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: action_args: {'id': '22d7bf3d-d6e9-4a78-bf74-77b44928b1d3'} Jun 03 10:04:52.692641 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:04:52.692641 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:04:52.692641 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:04:52.692641 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:04:52.692641 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:04:52.692641 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:04:52.692641 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:04:52.692641 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:04:52.692641 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:04:52.692641 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:04:52.692641 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 could not be found. Jun 03 10:04:52.692641 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:04:52.692641 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:04:52.692641 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:04:52.692641 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:04:52.692641 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:04:52.692641 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:04:52.692641 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:04:52.692641 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:04:52.692641 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:04:52.694206 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:04:52.694206 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 10:04:52.694206 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 10:04:52.694206 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 10:04:52.694206 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 10:04:52.694206 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:04:52.694206 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:04:52.694206 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:04:52.694206 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:04:52.694206 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 could not be found. Jun 03 10:04:52.694206 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:04:52.694206 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:04:52.694206 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:04:52.694206 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:04:52.694206 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:04:52.694206 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:04:52.694206 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:04:52.694206 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:04:52.694206 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 could not be found. Jun 03 10:04:52.694206 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:04:52.699864 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-b24d55b6-003a-46dc-9a93-398c9ca58679 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Returning 404 to user: Instance 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 could not be found. {{(pid=125065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:04:52.699864 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-b24d55b6-003a-46dc-9a93-398c9ca58679 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "DELETE /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 404 len: 111 microversion: 2.1 time: 0.033931 Jun 03 10:04:52.699864 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 422/834] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 3 10:04:52 2022] DELETE /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:04:52.705073 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-f1f157d8-573a-4d86-ad4c-b8fb4e2d0fb3 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:52.705726 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-f1f157d8-573a-4d86-ad4c-b8fb4e2d0fb3 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] [instance: 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:52.711817 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f1f157d8-573a-4d86-ad4c-b8fb4e2d0fb3 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:52.712267 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f1f157d8-573a-4d86-ad4c-b8fb4e2d0fb3 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:52.713090 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f1f157d8-573a-4d86-ad4c-b8fb4e2d0fb3 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:52.713529 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f1f157d8-573a-4d86-ad4c-b8fb4e2d0fb3 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:52.731816 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.wsgi [None req-f1f157d8-573a-4d86-ad4c-b8fb4e2d0fb3 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] HTTP exception thrown: Instance 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 could not be found. Jun 03 10:04:52.733423 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-f1f157d8-573a-4d86-ad4c-b8fb4e2d0fb3 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Request method failure captured: Jun 03 10:04:52.733423 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: request: GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 HTTP/1.1 Jun 03 10:04:52.733423 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept: application/json Jun 03 10:04:52.733423 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept-Encoding: identity Jun 03 10:04:52.733423 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Connection: close Jun 03 10:04:52.733423 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Length: 0 Jun 03 10:04:52.733423 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Type: application/json Jun 03 10:04:52.733423 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Host: 10.222.0.42 Jun 03 10:04:52.733423 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Openstack-System-Scope: None Jun 03 10:04:52.733423 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: User-Agent: python-urllib3/1.26.9 Jun 03 10:04:52.733423 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Auth-Token: gAAAAABimdtBMxI1_XARv6zROzpVvCk5TBiT12tdRbdOvk6wC3oEf1-r8UmrTZdYHxthXgJhwuyEo3PRevUOlHG2OvaZyxBk3IoOTJn-eXtqweY8QkNyg2GJrJmEcGTYbKMr9Rbr20vV9fu-8zaHcMKp5wE--6uSFsvysYsmZl5fOZlY92hSGXA Jun 03 10:04:52.733423 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Id: None Jun 03 10:04:52.733423 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Name: None Jun 03 10:04:52.733423 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Identity-Status: Confirmed Jun 03 10:04:52.733423 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Is-Admin-Project: True Jun 03 10:04:52.733423 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Id: default Jun 03 10:04:52.733423 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Name: Default Jun 03 10:04:52.733423 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Id: 686f552be5824c8aa31930a6e8844255 Jun 03 10:04:52.733423 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Name: tempest-AttachVolumeTestJSON-145001499 Jun 03 10:04:52.733423 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Role: member,reader Jun 03 10:04:52.733423 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Roles: member,reader Jun 03 10:04:52.734761 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/686f552be5824c8aa31930a6e8844255"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/686f552be5824c8aa31930a6e8844255"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_686f552be5824c8aa31930a6e8844255", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/686f552be5824c8aa31930a6e8844255"}]}] Jun 03 10:04:52.734761 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant: tempest-AttachVolumeTestJSON-145001499 Jun 03 10:04:52.734761 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Id: 686f552be5824c8aa31930a6e8844255 Jun 03 10:04:52.734761 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Name: tempest-AttachVolumeTestJSON-145001499 Jun 03 10:04:52.734761 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User: tempest-AttachVolumeTestJSON-145001499-project Jun 03 10:04:52.734761 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Id: default Jun 03 10:04:52.734761 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Name: Default Jun 03 10:04:52.734761 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Id: 49efae911ef8458b9288558014217934 Jun 03 10:04:52.734761 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Name: tempest-AttachVolumeTestJSON-145001499-project Jun 03 10:04:52.734761 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: method: > Jun 03 10:04:52.734761 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: exception: Instance 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 could not be found. Jun 03 10:04:52.734761 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: action_args: {'id': '22d7bf3d-d6e9-4a78-bf74-77b44928b1d3'} Jun 03 10:04:52.735505 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:04:52.735505 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:04:52.735505 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:04:52.735505 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:04:52.735505 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:04:52.735505 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:04:52.735505 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:04:52.735505 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:04:52.735505 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:04:52.735505 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:04:52.735505 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 could not be found. Jun 03 10:04:52.735505 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:04:52.735505 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:04:52.735505 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:04:52.735505 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:04:52.735505 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:04:52.735505 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:04:52.735505 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:04:52.735505 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:04:52.735505 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:04:52.737325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:04:52.737325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:04:52.737325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:04:52.737325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:04:52.737325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:04:52.737325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:04:52.737325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:04:52.737325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 could not be found. Jun 03 10:04:52.737325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:04:52.737325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:04:52.737325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:04:52.737325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:04:52.737325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:04:52.737325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:04:52.737325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:04:52.737325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:04:52.737325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 could not be found. Jun 03 10:04:52.737325 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:04:52.738425 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-f1f157d8-573a-4d86-ad4c-b8fb4e2d0fb3 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] Returning 404 to user: Instance 22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 could not be found. {{(pid=125065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:04:52.738425 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-f1f157d8-573a-4d86-ad4c-b8fb4e2d0fb3 tempest-AttachVolumeTestJSON-145001499 tempest-AttachVolumeTestJSON-145001499-project] 10.222.0.42 "GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3" status: 404 len: 111 microversion: 2.1 time: 0.033548 Jun 03 10:04:52.738425 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 423/835] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:52 2022] GET /compute/v2.1/servers/22d7bf3d-d6e9-4a78-bf74-77b44928b1d3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 10:04:52.768421 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-d49c00f3-f027-42ba-a8c1-9ba79f3eb840 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:52.769702 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-d49c00f3-f027-42ba-a8c1-9ba79f3eb840 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a" status: 200 len: 1266 microversion: 2.1 time: 0.169110 Jun 03 10:04:52.770367 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 413/836] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:52 2022] GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:53.617527 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-1b69ba21-8c70-460c-8f9b-f5c48dfc18e1 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:53.618306 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-1b69ba21-8c70-460c-8f9b-f5c48dfc18e1 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:53.632330 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1b69ba21-8c70-460c-8f9b-f5c48dfc18e1 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:53.632798 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1b69ba21-8c70-460c-8f9b-f5c48dfc18e1 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:53.636199 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1b69ba21-8c70-460c-8f9b-f5c48dfc18e1 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:53.636199 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1b69ba21-8c70-460c-8f9b-f5c48dfc18e1 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:53.787754 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-427ec250-af49-486b-89fc-9175cc43936e tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:53.788370 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-427ec250-af49-486b-89fc-9175cc43936e tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: acca7e36-982b-4fc4-a4a6-8e34f7b25d7a] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:53.795575 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-427ec250-af49-486b-89fc-9175cc43936e tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:53.796091 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-427ec250-af49-486b-89fc-9175cc43936e tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:53.796813 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-427ec250-af49-486b-89fc-9175cc43936e tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:53.797247 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-427ec250-af49-486b-89fc-9175cc43936e tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:53.798158 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-1b69ba21-8c70-460c-8f9b-f5c48dfc18e1 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:53.807245 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-1b69ba21-8c70-460c-8f9b-f5c48dfc18e1 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1568 microversion: 2.1 time: 0.194206 Jun 03 10:04:53.807932 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 424/837] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:53 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:53.973245 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-427ec250-af49-486b-89fc-9175cc43936e tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:53.981909 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-427ec250-af49-486b-89fc-9175cc43936e tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a" status: 200 len: 1266 microversion: 2.1 time: 0.198941 Jun 03 10:04:53.982644 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 414/838] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:53 2022] GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:04:54.823616 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-a37d5bf7-d9b4-4599-927b-50dad2e4eb3d tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:54.824231 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-a37d5bf7-d9b4-4599-927b-50dad2e4eb3d tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:54.831563 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a37d5bf7-d9b4-4599-927b-50dad2e4eb3d tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:54.832012 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a37d5bf7-d9b4-4599-927b-50dad2e4eb3d tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:54.832795 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a37d5bf7-d9b4-4599-927b-50dad2e4eb3d tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:54.833216 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a37d5bf7-d9b4-4599-927b-50dad2e4eb3d tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:54.999359 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-57e72b1e-103d-479a-97d2-f8f95e65ec8f tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:55.000669 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-57e72b1e-103d-479a-97d2-f8f95e65ec8f tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: acca7e36-982b-4fc4-a4a6-8e34f7b25d7a] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:55.007776 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-57e72b1e-103d-479a-97d2-f8f95e65ec8f tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:55.008798 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-57e72b1e-103d-479a-97d2-f8f95e65ec8f tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:55.009806 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-57e72b1e-103d-479a-97d2-f8f95e65ec8f tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:55.010480 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-57e72b1e-103d-479a-97d2-f8f95e65ec8f tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:55.073595 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-a37d5bf7-d9b4-4599-927b-50dad2e4eb3d tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:55.085694 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-a37d5bf7-d9b4-4599-927b-50dad2e4eb3d tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1568 microversion: 2.1 time: 0.262297 Jun 03 10:04:55.085694 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 425/839] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:54 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1568 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:55.237973 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-57e72b1e-103d-479a-97d2-f8f95e65ec8f tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:55.247010 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-57e72b1e-103d-479a-97d2-f8f95e65ec8f tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a" status: 200 len: 1266 microversion: 2.1 time: 0.251344 Jun 03 10:04:55.247590 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 415/840] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:54 2022] GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:04:55.438545 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-c1f8951b-d4c4-4ad7-a5ea-96a94b2b10f0 req-76a01686-b513-4cf2-8acc-159e4b24f054 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acca7e36-982b-4fc4-a4a6-8e34f7b25d7a", "name": "network-vif-plugged", "status": "completed", "tag": "4bc88b77-b7fa-4b6a-90b4-2750b5baa1c9"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:04:55.452662 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-c1f8951b-d4c4-4ad7-a5ea-96a94b2b10f0 req-76a01686-b513-4cf2-8acc-159e4b24f054 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:55.453122 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-c1f8951b-d4c4-4ad7-a5ea-96a94b2b10f0 req-76a01686-b513-4cf2-8acc-159e4b24f054 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:55.467775 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-c1f8951b-d4c4-4ad7-a5ea-96a94b2b10f0 req-76a01686-b513-4cf2-8acc-159e4b24f054 service nova] Creating event network-vif-plugged:4bc88b77-b7fa-4b6a-90b4-2750b5baa1c9 for instance acca7e36-982b-4fc4-a4a6-8e34f7b25d7a on hv-cinder-84456 Jun 03 10:04:55.473807 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-c1f8951b-d4c4-4ad7-a5ea-96a94b2b10f0 req-76a01686-b513-4cf2-8acc-159e4b24f054 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039016 Jun 03 10:04:55.478178 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 426/841] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:04:55.609467 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-12b0bdf3-602d-4a70-9423-23bea543ca2b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1207597028", "imageRef": "0d2dd03b-4531-46f3-88da-0380e97b1bd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "284be7b5-7c4f-4f54-b772-bb0f4e7cb533"}], "security_groups": [{"name": "tempest-securitygroup--795157077"}], "key_name": "tempest-keypair-1253900515", "user_data": "}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:04:55.774878 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.network.neutron [None req-12b0bdf3-602d-4a70-9423-23bea543ca2b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] validate_networks() for [('284be7b5-7c4f-4f54-b772-bb0f4e7cb533', None, None, None, None, None)] {{(pid=125066) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 10:04:56.101696 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-b422cf82-455c-43ad-a078-2e0fad5b4b7e tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:56.102342 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-b422cf82-455c-43ad-a078-2e0fad5b4b7e tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:56.108502 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b422cf82-455c-43ad-a078-2e0fad5b4b7e tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:56.108957 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b422cf82-455c-43ad-a078-2e0fad5b4b7e tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:56.109726 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b422cf82-455c-43ad-a078-2e0fad5b4b7e tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:56.110202 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b422cf82-455c-43ad-a078-2e0fad5b4b7e tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:56.398203 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-b422cf82-455c-43ad-a078-2e0fad5b4b7e tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:56.408898 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-b422cf82-455c-43ad-a078-2e0fad5b4b7e tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1568 microversion: 2.1 time: 0.311825 Jun 03 10:04:56.409500 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 427/842] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:56 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1568 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:04:56.419416 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-d3da3065-4096-419c-9572-9bc3aa47bc51 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:56.424522 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-d3da3065-4096-419c-9572-9bc3aa47bc51 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: acca7e36-982b-4fc4-a4a6-8e34f7b25d7a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:56.430888 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d3da3065-4096-419c-9572-9bc3aa47bc51 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:56.431563 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d3da3065-4096-419c-9572-9bc3aa47bc51 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:56.432488 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d3da3065-4096-419c-9572-9bc3aa47bc51 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:56.433073 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d3da3065-4096-419c-9572-9bc3aa47bc51 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:56.453946 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-12b0bdf3-602d-4a70-9423-23bea543ca2b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Flavor limits 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 10:04:56.454526 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-12b0bdf3-602d-4a70-9423-23bea543ca2b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Image limits 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 10:04:56.455262 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-12b0bdf3-602d-4a70-9423-23bea543ca2b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Flavor pref 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 10:04:56.455885 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-12b0bdf3-602d-4a70-9423-23bea543ca2b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Image pref 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 10:04:56.456372 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-12b0bdf3-602d-4a70-9423-23bea543ca2b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 10:04:56.468849 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-12b0bdf3-602d-4a70-9423-23bea543ca2b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:56.470101 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-12b0bdf3-602d-4a70-9423-23bea543ca2b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:56.472037 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-12b0bdf3-602d-4a70-9423-23bea543ca2b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:56.472681 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-12b0bdf3-602d-4a70-9423-23bea543ca2b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:56.496959 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-12b0bdf3-602d-4a70-9423-23bea543ca2b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Getting quotas for project 3e51010dd5d84daf8aa43859e9e7cb6d. Resources: {'ram', 'instances', 'cores'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:04:56.501947 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-12b0bdf3-602d-4a70-9423-23bea543ca2b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Getting quotas for user ce77221a2c8d4c4395bed092c1967b28 and project 3e51010dd5d84daf8aa43859e9e7cb6d. Resources: {'ram', 'instances', 'cores'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:04:56.514804 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-12b0bdf3-602d-4a70-9423-23bea543ca2b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Going to run 1 instances... {{(pid=125066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 10:04:56.518086 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-12b0bdf3-602d-4a70-9423-23bea543ca2b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: aa10760a-d45e-497a-8f67-9cd6ed2eb585] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2dd03b-4531-46f3-88da-0380e97b1bd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 10:04:56.587484 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-d3da3065-4096-419c-9572-9bc3aa47bc51 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:56.595101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-d3da3065-4096-419c-9572-9bc3aa47bc51 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a" status: 200 len: 1266 microversion: 2.1 time: 0.179306 Jun 03 10:04:56.595680 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 428/843] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:56 2022] GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:56.726814 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-12b0bdf3-602d-4a70-9423-23bea543ca2b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.121612 Jun 03 10:04:56.727534 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 416/844] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 3 10:04:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 10:04:56.737381 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-f7cd20f5-074b-4645-93ba-3e0ca313a577 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:56.738025 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-f7cd20f5-074b-4645-93ba-3e0ca313a577 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: aa10760a-d45e-497a-8f67-9cd6ed2eb585] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:56.803014 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f7cd20f5-074b-4645-93ba-3e0ca313a577 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:56.810713 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-f7cd20f5-074b-4645-93ba-3e0ca313a577 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585" status: 200 len: 1242 microversion: 2.1 time: 0.077106 Jun 03 10:04:56.811481 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 429/845] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:56 2022] GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585 => generated 1242 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:57.426799 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-1bde618b-04ea-48c7-a04b-d8190ebe07a0 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:57.427543 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-1bde618b-04ea-48c7-a04b-d8190ebe07a0 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:57.434855 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1bde618b-04ea-48c7-a04b-d8190ebe07a0 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:57.435311 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1bde618b-04ea-48c7-a04b-d8190ebe07a0 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:57.436088 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1bde618b-04ea-48c7-a04b-d8190ebe07a0 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:57.436597 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-1bde618b-04ea-48c7-a04b-d8190ebe07a0 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:57.613217 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-d643f646-5195-4a9c-babc-ba640cb77dd1 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:57.613585 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-d643f646-5195-4a9c-babc-ba640cb77dd1 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: acca7e36-982b-4fc4-a4a6-8e34f7b25d7a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:57.621466 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d643f646-5195-4a9c-babc-ba640cb77dd1 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:57.623272 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d643f646-5195-4a9c-babc-ba640cb77dd1 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:57.623272 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d643f646-5195-4a9c-babc-ba640cb77dd1 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:57.624070 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d643f646-5195-4a9c-babc-ba640cb77dd1 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:57.639038 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-1bde618b-04ea-48c7-a04b-d8190ebe07a0 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:57.647710 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-1bde618b-04ea-48c7-a04b-d8190ebe07a0 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1568 microversion: 2.1 time: 0.225644 Jun 03 10:04:57.648373 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 417/846] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:57 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:57.826331 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-d643f646-5195-4a9c-babc-ba640cb77dd1 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:57.829284 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-e98c2705-fcd2-4459-a44f-4a82215a7c5a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:57.834412 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-e98c2705-fcd2-4459-a44f-4a82215a7c5a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: aa10760a-d45e-497a-8f67-9cd6ed2eb585] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:57.836603 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e98c2705-fcd2-4459-a44f-4a82215a7c5a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:57.837446 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e98c2705-fcd2-4459-a44f-4a82215a7c5a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:57.838415 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e98c2705-fcd2-4459-a44f-4a82215a7c5a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:57.839032 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e98c2705-fcd2-4459-a44f-4a82215a7c5a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:57.841766 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-d643f646-5195-4a9c-babc-ba640cb77dd1 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a" status: 200 len: 1453 microversion: 2.1 time: 0.232834 Jun 03 10:04:57.846572 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 430/847] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:57 2022] GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a => generated 1453 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:04:57.860976 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-2591ff9f-2b26-4c50-8746-698db5a8f6bf tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:57.863098 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-2591ff9f-2b26-4c50-8746-698db5a8f6bf tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: acca7e36-982b-4fc4-a4a6-8e34f7b25d7a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:57.868677 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2591ff9f-2b26-4c50-8746-698db5a8f6bf tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:57.869349 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2591ff9f-2b26-4c50-8746-698db5a8f6bf tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:57.870740 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2591ff9f-2b26-4c50-8746-698db5a8f6bf tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:57.871513 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2591ff9f-2b26-4c50-8746-698db5a8f6bf tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:57.959821 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-e98c2705-fcd2-4459-a44f-4a82215a7c5a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:57.967540 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-e98c2705-fcd2-4459-a44f-4a82215a7c5a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585" status: 200 len: 1246 microversion: 2.1 time: 0.142977 Jun 03 10:04:57.968107 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 418/848] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:57 2022] GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585 => generated 1246 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:04:58.119112 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-2591ff9f-2b26-4c50-8746-698db5a8f6bf tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:58.128361 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-2591ff9f-2b26-4c50-8746-698db5a8f6bf tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a" status: 200 len: 1453 microversion: 2.1 time: 0.273270 Jun 03 10:04:58.129455 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 431/849] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:57 2022] GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a => generated 1453 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:58.664865 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-69357c3a-b57e-4d60-8547-ad4bf4095736 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:58.665480 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-69357c3a-b57e-4d60-8547-ad4bf4095736 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:58.672080 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-69357c3a-b57e-4d60-8547-ad4bf4095736 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:58.672535 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-69357c3a-b57e-4d60-8547-ad4bf4095736 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:58.673408 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-69357c3a-b57e-4d60-8547-ad4bf4095736 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:58.673962 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-69357c3a-b57e-4d60-8547-ad4bf4095736 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:58.812646 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-69357c3a-b57e-4d60-8547-ad4bf4095736 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:58.823763 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-69357c3a-b57e-4d60-8547-ad4bf4095736 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1568 microversion: 2.1 time: 0.162309 Jun 03 10:04:58.824146 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 419/850] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:58 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:58.985681 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-b9f76cb1-fff2-4d12-bfd7-f52039a6948c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:58.987602 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-b9f76cb1-fff2-4d12-bfd7-f52039a6948c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: aa10760a-d45e-497a-8f67-9cd6ed2eb585] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:58.994187 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b9f76cb1-fff2-4d12-bfd7-f52039a6948c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:58.994643 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b9f76cb1-fff2-4d12-bfd7-f52039a6948c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:58.995406 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b9f76cb1-fff2-4d12-bfd7-f52039a6948c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:58.995837 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b9f76cb1-fff2-4d12-bfd7-f52039a6948c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:59.065783 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-b9f76cb1-fff2-4d12-bfd7-f52039a6948c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:59.074263 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-b9f76cb1-fff2-4d12-bfd7-f52039a6948c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585" status: 200 len: 1238 microversion: 2.1 time: 0.093544 Jun 03 10:04:59.074857 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 432/851] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:58 2022] GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585 => generated 1238 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:59.840925 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-4c9bd66c-97ee-4f86-8060-3ab5892ce31f tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:59.841594 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-4c9bd66c-97ee-4f86-8060-3ab5892ce31f tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:59.848203 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4c9bd66c-97ee-4f86-8060-3ab5892ce31f tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:59.848859 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4c9bd66c-97ee-4f86-8060-3ab5892ce31f tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:59.849649 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4c9bd66c-97ee-4f86-8060-3ab5892ce31f tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:59.850110 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4c9bd66c-97ee-4f86-8060-3ab5892ce31f tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:00.017517 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-4c9bd66c-97ee-4f86-8060-3ab5892ce31f tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:00.036731 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-4c9bd66c-97ee-4f86-8060-3ab5892ce31f tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1568 microversion: 2.1 time: 0.196820 Jun 03 10:05:00.037348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 420/852] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:59 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1568 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:00.090887 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-203c19de-8445-4a12-910d-d67ada7cd3ee tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:00.091590 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-203c19de-8445-4a12-910d-d67ada7cd3ee tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: aa10760a-d45e-497a-8f67-9cd6ed2eb585] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:00.098682 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-203c19de-8445-4a12-910d-d67ada7cd3ee tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:00.105503 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-203c19de-8445-4a12-910d-d67ada7cd3ee tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:00.105503 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-203c19de-8445-4a12-910d-d67ada7cd3ee tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:00.105503 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-203c19de-8445-4a12-910d-d67ada7cd3ee tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:00.170796 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-203c19de-8445-4a12-910d-d67ada7cd3ee tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:00.180198 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-203c19de-8445-4a12-910d-d67ada7cd3ee tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585" status: 200 len: 1294 microversion: 2.1 time: 0.093009 Jun 03 10:05:00.181208 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 433/853] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:00 2022] GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585 => generated 1294 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:00.280769 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-2639f11d-7282-4bdd-aaad-6237d76b38ff req-03339923-cdd5-49da-9bd4-02a15e95cf5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acca7e36-982b-4fc4-a4a6-8e34f7b25d7a", "tag": "4bc88b77-b7fa-4b6a-90b4-2750b5baa1c9"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:05:00.289832 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-2639f11d-7282-4bdd-aaad-6237d76b38ff req-03339923-cdd5-49da-9bd4-02a15e95cf5d service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:00.291145 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-2639f11d-7282-4bdd-aaad-6237d76b38ff req-03339923-cdd5-49da-9bd4-02a15e95cf5d service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:00.304554 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-2639f11d-7282-4bdd-aaad-6237d76b38ff req-03339923-cdd5-49da-9bd4-02a15e95cf5d service nova] Creating event network-changed:4bc88b77-b7fa-4b6a-90b4-2750b5baa1c9 for instance acca7e36-982b-4fc4-a4a6-8e34f7b25d7a on hv-cinder-84456 Jun 03 10:05:00.311319 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-2639f11d-7282-4bdd-aaad-6237d76b38ff req-03339923-cdd5-49da-9bd4-02a15e95cf5d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168124 Jun 03 10:05:00.312734 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 421/854] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:05:00.786074 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-c44e7721-50ee-4283-a600-954e34bed3b1 tempest-VolumesTestJSON-32118681 tempest-VolumesTestJSON-32118681-project] Calling method '.version_select at 0x7f8d23628040>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:00.850475 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-c44e7721-50ee-4283-a600-954e34bed3b1 tempest-VolumesTestJSON-32118681 tempest-VolumesTestJSON-32118681-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/b1a7745c-c2c6-41ed-8c24-a75301972d7f" status: 200 len: 351 microversion: 2.1 time: 0.075319 Jun 03 10:05:00.851185 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 434/855] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 3 10:05:00 2022] GET /compute/v2.1/os-volumes/b1a7745c-c2c6-41ed-8c24-a75301972d7f => generated 351 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:05:01.055665 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-4700d8ff-dcbd-4de6-87f5-fd61ff623a72 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:01.056372 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-4700d8ff-dcbd-4de6-87f5-fd61ff623a72 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:01.062790 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4700d8ff-dcbd-4de6-87f5-fd61ff623a72 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:01.063560 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4700d8ff-dcbd-4de6-87f5-fd61ff623a72 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:01.064355 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4700d8ff-dcbd-4de6-87f5-fd61ff623a72 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:01.065027 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4700d8ff-dcbd-4de6-87f5-fd61ff623a72 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:01.198192 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-9c91457a-e401-44e5-8c75-a47eeab00f1f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:01.198906 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-9c91457a-e401-44e5-8c75-a47eeab00f1f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: aa10760a-d45e-497a-8f67-9cd6ed2eb585] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:01.205149 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9c91457a-e401-44e5-8c75-a47eeab00f1f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:01.206290 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9c91457a-e401-44e5-8c75-a47eeab00f1f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:01.207067 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9c91457a-e401-44e5-8c75-a47eeab00f1f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:01.207505 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9c91457a-e401-44e5-8c75-a47eeab00f1f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:01.633341 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-9c91457a-e401-44e5-8c75-a47eeab00f1f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:01.635883 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-4700d8ff-dcbd-4de6-87f5-fd61ff623a72 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:01.636113 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-9c91457a-e401-44e5-8c75-a47eeab00f1f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585" status: 200 len: 1300 microversion: 2.1 time: 0.442689 Jun 03 10:05:01.636681 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 435/856] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:01 2022] GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585 => generated 1300 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:01.644593 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-4700d8ff-dcbd-4de6-87f5-fd61ff623a72 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1569 microversion: 2.1 time: 0.593767 Jun 03 10:05:01.645165 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 422/857] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:01 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1569 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:05:01.662452 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-931469c4-07cb-498e-ab77-2a70c5b6f472 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:05:01.663020 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-931469c4-07cb-498e-ab77-2a70c5b6f472 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:01.669151 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-931469c4-07cb-498e-ab77-2a70c5b6f472 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:01.669602 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-931469c4-07cb-498e-ab77-2a70c5b6f472 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:01.670422 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-931469c4-07cb-498e-ab77-2a70c5b6f472 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:01.670860 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-931469c4-07cb-498e-ab77-2a70c5b6f472 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:01.891542 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-931469c4-07cb-498e-ab77-2a70c5b6f472 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "POST /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0/action" status: 202 len: 0 microversion: 2.1 time: 0.234548 Jun 03 10:05:01.893032 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 436/858] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jun 3 10:05:01 2022] POST /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 03 10:05:01.904568 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-4da7c93a-2bfc-4c1a-be0e-886f6ca2c4e4 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:01.905173 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-4da7c93a-2bfc-4c1a-be0e-886f6ca2c4e4 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:01.923282 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4da7c93a-2bfc-4c1a-be0e-886f6ca2c4e4 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:01.926439 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4da7c93a-2bfc-4c1a-be0e-886f6ca2c4e4 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:01.927271 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4da7c93a-2bfc-4c1a-be0e-886f6ca2c4e4 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:01.934291 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4da7c93a-2bfc-4c1a-be0e-886f6ca2c4e4 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:02.127498 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-4da7c93a-2bfc-4c1a-be0e-886f6ca2c4e4 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:02.135675 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-4da7c93a-2bfc-4c1a-be0e-886f6ca2c4e4 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1517 microversion: 2.1 time: 0.234877 Jun 03 10:05:02.136250 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 423/859] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:01 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1517 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:02.595223 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-f1825277-942e-4a69-b48e-244360c747f7 tempest-VolumesTestJSON-32118681 tempest-VolumesTestJSON-32118681-project] Calling method '.version_select at 0x7f8d23597dc0>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:02.643513 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-f1825277-942e-4a69-b48e-244360c747f7 tempest-VolumesTestJSON-32118681 tempest-VolumesTestJSON-32118681-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/a430758f-4bb2-4511-98f1-348bc6aedfbb" status: 200 len: 350 microversion: 2.1 time: 0.051529 Jun 03 10:05:02.644221 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 437/860] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 3 10:05:02 2022] GET /compute/v2.1/os-volumes/a430758f-4bb2-4511-98f1-348bc6aedfbb => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:05:02.653940 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-e78cd1e7-7862-486e-bd95-38b5a77a7a07 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:02.655046 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-e78cd1e7-7862-486e-bd95-38b5a77a7a07 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: aa10760a-d45e-497a-8f67-9cd6ed2eb585] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:02.666931 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e78cd1e7-7862-486e-bd95-38b5a77a7a07 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:02.666931 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e78cd1e7-7862-486e-bd95-38b5a77a7a07 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:02.666931 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e78cd1e7-7862-486e-bd95-38b5a77a7a07 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:02.667319 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e78cd1e7-7862-486e-bd95-38b5a77a7a07 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:02.671677 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:SELECT=100 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:02.869580 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-e78cd1e7-7862-486e-bd95-38b5a77a7a07 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:02.877952 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-e78cd1e7-7862-486e-bd95-38b5a77a7a07 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585" status: 200 len: 1367 microversion: 2.1 time: 0.229146 Jun 03 10:05:02.879321 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 424/861] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:02 2022] GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:03.097323 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-00878392-397b-429a-8377-1b0bcf52a639 req-aa4779d0-9a28-4de8-a66c-1c8182284eac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa10760a-d45e-497a-8f67-9cd6ed2eb585", "tag": "69dac938-25d4-4980-b714-07010ccce88d"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:05:03.121451 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-00878392-397b-429a-8377-1b0bcf52a639 req-aa4779d0-9a28-4de8-a66c-1c8182284eac service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:03.122146 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-00878392-397b-429a-8377-1b0bcf52a639 req-aa4779d0-9a28-4de8-a66c-1c8182284eac service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:03.137997 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-00878392-397b-429a-8377-1b0bcf52a639 req-aa4779d0-9a28-4de8-a66c-1c8182284eac service nova] Creating event network-changed:69dac938-25d4-4980-b714-07010ccce88d for instance aa10760a-d45e-497a-8f67-9cd6ed2eb585 on hv-cinder-84456 Jun 03 10:05:03.144740 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-00878392-397b-429a-8377-1b0bcf52a639 req-aa4779d0-9a28-4de8-a66c-1c8182284eac service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056139 Jun 03 10:05:03.145463 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 438/862] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:05:03.154963 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-730a60a6-5f64-4b98-a4e6-29b90ecd4ea8 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:03.156365 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-730a60a6-5f64-4b98-a4e6-29b90ecd4ea8 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:03.167931 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-730a60a6-5f64-4b98-a4e6-29b90ecd4ea8 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:03.173615 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-730a60a6-5f64-4b98-a4e6-29b90ecd4ea8 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:03.173615 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-730a60a6-5f64-4b98-a4e6-29b90ecd4ea8 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:03.173615 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-730a60a6-5f64-4b98-a4e6-29b90ecd4ea8 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:03.400479 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-88f55c58-72fb-4d94-b5df-3659e87d7f95 req-c4934a52-72ac-4b90-85f3-a1070d44c8e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5afad0ea-b328-43cf-8ed2-f500796569b0", "name": "network-vif-unplugged", "status": "completed", "tag": "895de58e-9396-45ee-adb3-b1ce59bb1799"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:05:03.421013 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-88f55c58-72fb-4d94-b5df-3659e87d7f95 req-c4934a52-72ac-4b90-85f3-a1070d44c8e3 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:03.421464 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-88f55c58-72fb-4d94-b5df-3659e87d7f95 req-c4934a52-72ac-4b90-85f3-a1070d44c8e3 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:03.438635 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.compute.server_external_events [req-88f55c58-72fb-4d94-b5df-3659e87d7f95 req-c4934a52-72ac-4b90-85f3-a1070d44c8e3 service nova] Unable to find a host for instance 5afad0ea-b328-43cf-8ed2-f500796569b0. Dropping event network-vif-unplugged {{(pid=125065) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 03 10:05:03.439539 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-88f55c58-72fb-4d94-b5df-3659e87d7f95 req-c4934a52-72ac-4b90-85f3-a1070d44c8e3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.043198 Jun 03 10:05:03.443829 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 439/863] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 48 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 03 10:05:03.496228 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-730a60a6-5f64-4b98-a4e6-29b90ecd4ea8 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:03.504666 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-730a60a6-5f64-4b98-a4e6-29b90ecd4ea8 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1519 microversion: 2.1 time: 0.354835 Jun 03 10:05:03.505340 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 425/864] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:03 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1519 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:03.895172 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-7d938661-1e6b-49e2-a945-4fbafdc9bd8c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:03.895997 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-7d938661-1e6b-49e2-a945-4fbafdc9bd8c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: aa10760a-d45e-497a-8f67-9cd6ed2eb585] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:03.902827 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7d938661-1e6b-49e2-a945-4fbafdc9bd8c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:03.903289 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7d938661-1e6b-49e2-a945-4fbafdc9bd8c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:03.904291 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7d938661-1e6b-49e2-a945-4fbafdc9bd8c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:03.905139 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7d938661-1e6b-49e2-a945-4fbafdc9bd8c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:03.909711 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:04.052037 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-7d938661-1e6b-49e2-a945-4fbafdc9bd8c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:04.059340 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-7d938661-1e6b-49e2-a945-4fbafdc9bd8c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585" status: 200 len: 1367 microversion: 2.1 time: 0.167993 Jun 03 10:05:04.059842 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 440/865] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:03 2022] GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:04.391185 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-a2f4be7f-72f6-4041-ae5e-8fe6c86e081b tempest-VolumesTestJSON-32118681 tempest-VolumesTestJSON-32118681-project] Calling method '.version_select at 0x7f8d23ebc670>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:04.438145 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-a2f4be7f-72f6-4041-ae5e-8fe6c86e081b tempest-VolumesTestJSON-32118681 tempest-VolumesTestJSON-32118681-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/248ef1a3-7b8f-4af2-adb5-1b92f36efa43" status: 200 len: 351 microversion: 2.1 time: 0.050644 Jun 03 10:05:04.438702 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 426/866] 10.222.0.42 () {58 vars in 1244 bytes} [Fri Jun 3 10:05:04 2022] GET /compute/v2.1/os-volumes/248ef1a3-7b8f-4af2-adb5-1b92f36efa43 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:05:04.450113 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-2a77b732-08a3-4e89-817b-13272ad219c9 tempest-VolumesTestJSON-32118681 tempest-VolumesTestJSON-32118681-project] Calling method '.version_select at 0x7f8d23553310>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:04.522942 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-4561e301-36c8-4e83-9a5c-0f4bbf96fe6a tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:04.523554 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-4561e301-36c8-4e83-9a5c-0f4bbf96fe6a tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:04.529653 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4561e301-36c8-4e83-9a5c-0f4bbf96fe6a tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:04.530139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4561e301-36c8-4e83-9a5c-0f4bbf96fe6a tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:04.530972 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4561e301-36c8-4e83-9a5c-0f4bbf96fe6a tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:04.531442 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4561e301-36c8-4e83-9a5c-0f4bbf96fe6a tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:04.532196 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-2a77b732-08a3-4e89-817b-13272ad219c9 tempest-VolumesTestJSON-32118681 tempest-VolumesTestJSON-32118681-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085867 Jun 03 10:05:04.532934 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 441/867] 10.222.0.42 () {58 vars in 1133 bytes} [Fri Jun 3 10:05:04 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:04.545779 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-7f0064a2-8f29-44ea-ad6f-75c2d3f20bac tempest-VolumesTestJSON-32118681 tempest-VolumesTestJSON-32118681-project] Calling method '.version_select at 0x7f8d3516c940>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:04.627056 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-7f0064a2-8f29-44ea-ad6f-75c2d3f20bac tempest-VolumesTestJSON-32118681 tempest-VolumesTestJSON-32118681-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085244 Jun 03 10:05:04.627627 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 442/868] 10.222.0.42 () {58 vars in 1148 bytes} [Fri Jun 3 10:05:04 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:05:04.639712 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-e3033084-cb3f-4dd4-9bab-6266022b62b9 tempest-VolumesTestJSON-32118681 tempest-VolumesTestJSON-32118681-project] Calling method '.version_select at 0x7f8d2363a550>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:04.663339 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-4561e301-36c8-4e83-9a5c-0f4bbf96fe6a tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:04.670981 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-4561e301-36c8-4e83-9a5c-0f4bbf96fe6a tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1519 microversion: 2.1 time: 0.152001 Jun 03 10:05:04.671547 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 427/869] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:04 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:05:04.722054 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-e3033084-cb3f-4dd4-9bab-6266022b62b9 tempest-VolumesTestJSON-32118681 tempest-VolumesTestJSON-32118681-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085192 Jun 03 10:05:04.722836 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 443/870] 10.222.0.42 () {58 vars in 1133 bytes} [Fri Jun 3 10:05:04 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:05:04.733916 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-e6148712-9825-41d1-8ce7-ac317abf68f2 tempest-VolumesTestJSON-32118681 tempest-VolumesTestJSON-32118681-project] Calling method '.version_select at 0x7f8d23ebc430>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:04.971537 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-e6148712-9825-41d1-8ce7-ac317abf68f2 tempest-VolumesTestJSON-32118681 tempest-VolumesTestJSON-32118681-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.241262 Jun 03 10:05:04.972115 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 428/871] 10.222.0.42 () {58 vars in 1166 bytes} [Fri Jun 3 10:05:04 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:05:04.984003 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-25c7dcfa-29a5-46a2-92cc-07b706cf9844 tempest-VolumesTestJSON-32118681 tempest-VolumesTestJSON-32118681-project] Calling method '.version_select at 0x7f8d2354b040>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:05.061590 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-25c7dcfa-29a5-46a2-92cc-07b706cf9844 tempest-VolumesTestJSON-32118681 tempest-VolumesTestJSON-32118681-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.081557 Jun 03 10:05:05.062210 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 444/872] 10.222.0.42 () {58 vars in 1169 bytes} [Fri Jun 3 10:05:04 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:05:05.074861 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-133a5031-4aea-428a-9730-a3a1824d7501 tempest-VolumesTestJSON-32118681 tempest-VolumesTestJSON-32118681-project] Calling method '.version_select at 0x7f8d23e56700>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:05.075727 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-34c1e832-aa0b-466a-a149-ad958a0ff43a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:05.076345 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-34c1e832-aa0b-466a-a149-ad958a0ff43a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: aa10760a-d45e-497a-8f67-9cd6ed2eb585] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:05.083708 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-34c1e832-aa0b-466a-a149-ad958a0ff43a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:05.084371 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-34c1e832-aa0b-466a-a149-ad958a0ff43a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:05.085215 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-34c1e832-aa0b-466a-a149-ad958a0ff43a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:05.085759 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-34c1e832-aa0b-466a-a149-ad958a0ff43a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:05.158230 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-133a5031-4aea-428a-9730-a3a1824d7501 tempest-VolumesTestJSON-32118681 tempest-VolumesTestJSON-32118681-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.087162 Jun 03 10:05:05.158838 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 429/873] 10.222.0.42 () {58 vars in 1154 bytes} [Fri Jun 3 10:05:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:05.169835 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-f3e073c7-79cf-41ed-800e-03eadbfba12f tempest-VolumesTestJSON-32118681 tempest-VolumesTestJSON-32118681-project] Calling method '.version_select at 0x7f8d23e68430>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:05.232495 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-34c1e832-aa0b-466a-a149-ad958a0ff43a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:05.241364 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-34c1e832-aa0b-466a-a149-ad958a0ff43a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585" status: 200 len: 1367 microversion: 2.1 time: 0.169386 Jun 03 10:05:05.251086 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 445/874] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:05 2022] GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:05:05.258184 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-f3e073c7-79cf-41ed-800e-03eadbfba12f tempest-VolumesTestJSON-32118681 tempest-VolumesTestJSON-32118681-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.091651 Jun 03 10:05:05.258779 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 430/875] 10.222.0.42 () {58 vars in 1187 bytes} [Fri Jun 3 10:05:05 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:05:05.270838 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-cbff1432-8d71-44a3-8043-1e0aa73a605d tempest-VolumesTestJSON-32118681 tempest-VolumesTestJSON-32118681-project] Calling method '.version_select at 0x7f8d2354b430>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:05.364928 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-cbff1432-8d71-44a3-8043-1e0aa73a605d tempest-VolumesTestJSON-32118681 tempest-VolumesTestJSON-32118681-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.098180 Jun 03 10:05:05.365516 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 446/876] 10.222.0.42 () {58 vars in 1154 bytes} [Fri Jun 3 10:05:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:05.688439 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-f6678b94-f13c-4645-9aa4-ee6b520e62f7 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:05.689054 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-f6678b94-f13c-4645-9aa4-ee6b520e62f7 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:05.695219 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f6678b94-f13c-4645-9aa4-ee6b520e62f7 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:05.695669 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f6678b94-f13c-4645-9aa4-ee6b520e62f7 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:05.696427 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f6678b94-f13c-4645-9aa4-ee6b520e62f7 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:05.696865 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f6678b94-f13c-4645-9aa4-ee6b520e62f7 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:05.828141 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-f6678b94-f13c-4645-9aa4-ee6b520e62f7 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:05.835933 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-f6678b94-f13c-4645-9aa4-ee6b520e62f7 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1575 microversion: 2.1 time: 0.151856 Jun 03 10:05:05.836564 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 431/877] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:05 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:06.259298 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-a6a657b5-4c08-4532-962a-2687931071b4 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:06.264752 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-a6a657b5-4c08-4532-962a-2687931071b4 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: aa10760a-d45e-497a-8f67-9cd6ed2eb585] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:06.269626 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a6a657b5-4c08-4532-962a-2687931071b4 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:06.270228 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a6a657b5-4c08-4532-962a-2687931071b4 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:06.271010 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a6a657b5-4c08-4532-962a-2687931071b4 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:06.271454 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a6a657b5-4c08-4532-962a-2687931071b4 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:06.470761 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-a6a657b5-4c08-4532-962a-2687931071b4 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:06.511097 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-a6a657b5-4c08-4532-962a-2687931071b4 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585" status: 200 len: 1367 microversion: 2.1 time: 0.224014 Jun 03 10:05:06.511097 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 447/878] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:06 2022] GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:06.854078 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-847f6cf8-bd0c-4826-842b-c50e34025663 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:06.854723 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-847f6cf8-bd0c-4826-842b-c50e34025663 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:06.856589 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell0:SELECT=2 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:06.857278 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell0:SELECT=6 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:06.863143 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-847f6cf8-bd0c-4826-842b-c50e34025663 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:06.863597 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-847f6cf8-bd0c-4826-842b-c50e34025663 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:06.864417 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-847f6cf8-bd0c-4826-842b-c50e34025663 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:06.864857 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-847f6cf8-bd0c-4826-842b-c50e34025663 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:07.000458 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-847f6cf8-bd0c-4826-842b-c50e34025663 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:07.009230 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-847f6cf8-bd0c-4826-842b-c50e34025663 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1575 microversion: 2.1 time: 0.159159 Jun 03 10:05:07.009791 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 432/879] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:06 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:07.452410 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-b2c0149e-8f93-4b62-873d-669ec5ee6373 req-d6b7e13e-e79a-44a1-840c-3afd2918d902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa10760a-d45e-497a-8f67-9cd6ed2eb585", "name": "network-vif-plugged", "status": "completed", "tag": "69dac938-25d4-4980-b714-07010ccce88d"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:05:07.456906 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell0:SELECT=6 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:07.462606 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-b2c0149e-8f93-4b62-873d-669ec5ee6373 req-d6b7e13e-e79a-44a1-840c-3afd2918d902 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:07.463042 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-b2c0149e-8f93-4b62-873d-669ec5ee6373 req-d6b7e13e-e79a-44a1-840c-3afd2918d902 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:07.474232 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-b2c0149e-8f93-4b62-873d-669ec5ee6373 req-d6b7e13e-e79a-44a1-840c-3afd2918d902 service nova] Creating event network-vif-plugged:69dac938-25d4-4980-b714-07010ccce88d for instance aa10760a-d45e-497a-8f67-9cd6ed2eb585 on hv-cinder-84456 Jun 03 10:05:07.479316 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-b2c0149e-8f93-4b62-873d-669ec5ee6373 req-d6b7e13e-e79a-44a1-840c-3afd2918d902 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030448 Jun 03 10:05:07.479847 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 448/880] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:05:07.494846 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-127416ee-1e8b-499e-8844-683b694843d2 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:07.495521 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-127416ee-1e8b-499e-8844-683b694843d2 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: aa10760a-d45e-497a-8f67-9cd6ed2eb585] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:07.501381 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-127416ee-1e8b-499e-8844-683b694843d2 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:07.501828 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-127416ee-1e8b-499e-8844-683b694843d2 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:07.502620 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-127416ee-1e8b-499e-8844-683b694843d2 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:07.503054 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-127416ee-1e8b-499e-8844-683b694843d2 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:07.635323 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-127416ee-1e8b-499e-8844-683b694843d2 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:07.643319 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-127416ee-1e8b-499e-8844-683b694843d2 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585" status: 200 len: 1367 microversion: 2.1 time: 0.151866 Jun 03 10:05:07.643899 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 433/881] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:07 2022] GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:08.026580 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-c68ba09f-8443-40a5-ba9a-d4ff8b1f4d3c tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:08.027356 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-c68ba09f-8443-40a5-ba9a-d4ff8b1f4d3c tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:08.034373 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c68ba09f-8443-40a5-ba9a-d4ff8b1f4d3c tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:08.034839 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c68ba09f-8443-40a5-ba9a-d4ff8b1f4d3c tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:08.035602 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c68ba09f-8443-40a5-ba9a-d4ff8b1f4d3c tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:08.036039 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c68ba09f-8443-40a5-ba9a-d4ff8b1f4d3c tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:08.169248 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-c68ba09f-8443-40a5-ba9a-d4ff8b1f4d3c tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:08.177395 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-c68ba09f-8443-40a5-ba9a-d4ff8b1f4d3c tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1575 microversion: 2.1 time: 0.155009 Jun 03 10:05:08.177982 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 449/882] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:08 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:05:08.659965 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-f1e3323e-0d6d-4fe6-a57e-6e74067b0934 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:08.660599 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-f1e3323e-0d6d-4fe6-a57e-6e74067b0934 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: aa10760a-d45e-497a-8f67-9cd6ed2eb585] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:08.667174 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f1e3323e-0d6d-4fe6-a57e-6e74067b0934 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:08.667617 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f1e3323e-0d6d-4fe6-a57e-6e74067b0934 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:08.668367 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f1e3323e-0d6d-4fe6-a57e-6e74067b0934 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:08.668796 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f1e3323e-0d6d-4fe6-a57e-6e74067b0934 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:08.799577 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-f1e3323e-0d6d-4fe6-a57e-6e74067b0934 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:08.807222 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-f1e3323e-0d6d-4fe6-a57e-6e74067b0934 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585" status: 200 len: 1367 microversion: 2.1 time: 0.151136 Jun 03 10:05:08.807795 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 434/883] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:08 2022] GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:09.195390 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-f7c08cd8-3f78-476b-ab99-34c8334a934b tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:09.196026 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-f7c08cd8-3f78-476b-ab99-34c8334a934b tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:09.202644 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f7c08cd8-3f78-476b-ab99-34c8334a934b tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:09.203114 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f7c08cd8-3f78-476b-ab99-34c8334a934b tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:09.203887 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f7c08cd8-3f78-476b-ab99-34c8334a934b tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:09.204385 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f7c08cd8-3f78-476b-ab99-34c8334a934b tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:09.334875 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f7c08cd8-3f78-476b-ab99-34c8334a934b tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:09.343160 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-f7c08cd8-3f78-476b-ab99-34c8334a934b tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1575 microversion: 2.1 time: 0.151647 Jun 03 10:05:09.343729 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 450/884] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:09 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:09.824741 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-ab9ba629-7292-4ffa-aeb8-d7548d4cb1a7 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:09.825355 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-ab9ba629-7292-4ffa-aeb8-d7548d4cb1a7 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: aa10760a-d45e-497a-8f67-9cd6ed2eb585] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:09.832500 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ab9ba629-7292-4ffa-aeb8-d7548d4cb1a7 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:09.832954 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ab9ba629-7292-4ffa-aeb8-d7548d4cb1a7 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:09.833723 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ab9ba629-7292-4ffa-aeb8-d7548d4cb1a7 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:09.834332 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ab9ba629-7292-4ffa-aeb8-d7548d4cb1a7 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:09.965741 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-ab9ba629-7292-4ffa-aeb8-d7548d4cb1a7 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:09.974055 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-ab9ba629-7292-4ffa-aeb8-d7548d4cb1a7 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585" status: 200 len: 1556 microversion: 2.1 time: 0.153364 Jun 03 10:05:09.974636 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 435/885] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:09 2022] GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:09.990165 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-6849ffef-2fe8-4334-89d6-28822035ede2 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:09.990736 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-6849ffef-2fe8-4334-89d6-28822035ede2 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: aa10760a-d45e-497a-8f67-9cd6ed2eb585] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:09.996936 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6849ffef-2fe8-4334-89d6-28822035ede2 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:10.001205 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6849ffef-2fe8-4334-89d6-28822035ede2 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:10.001205 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6849ffef-2fe8-4334-89d6-28822035ede2 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:10.001205 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6849ffef-2fe8-4334-89d6-28822035ede2 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:10.100672 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-6849ffef-2fe8-4334-89d6-28822035ede2 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114433 Jun 03 10:05:10.101281 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 451/886] 10.222.0.42 () {58 vars in 1274 bytes} [Fri Jun 3 10:05:09 2022] GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:05:10.360632 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-c830cd3f-de21-4cee-b3f5-d6611550afe5 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:10.361236 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-c830cd3f-de21-4cee-b3f5-d6611550afe5 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:10.368025 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c830cd3f-de21-4cee-b3f5-d6611550afe5 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:10.368468 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c830cd3f-de21-4cee-b3f5-d6611550afe5 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:10.369290 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c830cd3f-de21-4cee-b3f5-d6611550afe5 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:10.369689 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c830cd3f-de21-4cee-b3f5-d6611550afe5 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:10.518509 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-c830cd3f-de21-4cee-b3f5-d6611550afe5 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:10.527355 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-c830cd3f-de21-4cee-b3f5-d6611550afe5 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1575 microversion: 2.1 time: 0.170634 Jun 03 10:05:10.527940 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 436/887] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:10 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:11.231603 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-50d1dbcf-540d-471b-9224-4aad2477498c req-4fe6283e-e05f-476f-87e4-eee83f0335b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa10760a-d45e-497a-8f67-9cd6ed2eb585", "tag": "69dac938-25d4-4980-b714-07010ccce88d"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:05:11.243251 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-50d1dbcf-540d-471b-9224-4aad2477498c req-4fe6283e-e05f-476f-87e4-eee83f0335b9 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:11.243251 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-50d1dbcf-540d-471b-9224-4aad2477498c req-4fe6283e-e05f-476f-87e4-eee83f0335b9 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:11.255782 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-50d1dbcf-540d-471b-9224-4aad2477498c req-4fe6283e-e05f-476f-87e4-eee83f0335b9 service nova] Creating event network-changed:69dac938-25d4-4980-b714-07010ccce88d for instance aa10760a-d45e-497a-8f67-9cd6ed2eb585 on hv-cinder-84456 Jun 03 10:05:11.262669 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-50d1dbcf-540d-471b-9224-4aad2477498c req-4fe6283e-e05f-476f-87e4-eee83f0335b9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035126 Jun 03 10:05:11.263570 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 452/888] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:05:11.553516 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-c29b23d8-0e47-467f-b57f-1b65cc5b1354 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:11.553516 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-c29b23d8-0e47-467f-b57f-1b65cc5b1354 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:11.556041 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c29b23d8-0e47-467f-b57f-1b65cc5b1354 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:11.556558 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c29b23d8-0e47-467f-b57f-1b65cc5b1354 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:11.557448 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c29b23d8-0e47-467f-b57f-1b65cc5b1354 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:11.557920 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c29b23d8-0e47-467f-b57f-1b65cc5b1354 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:11.782001 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-c29b23d8-0e47-467f-b57f-1b65cc5b1354 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:11.790788 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-c29b23d8-0e47-467f-b57f-1b65cc5b1354 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1575 microversion: 2.1 time: 0.248251 Jun 03 10:05:11.791449 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 437/889] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:11 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1575 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:12.811342 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-a2ae7ef6-0d0a-499d-92ce-af33a1fdcfd3 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:12.812208 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-a2ae7ef6-0d0a-499d-92ce-af33a1fdcfd3 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:12.819015 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a2ae7ef6-0d0a-499d-92ce-af33a1fdcfd3 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:12.819471 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a2ae7ef6-0d0a-499d-92ce-af33a1fdcfd3 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:12.820328 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a2ae7ef6-0d0a-499d-92ce-af33a1fdcfd3 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:12.820696 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a2ae7ef6-0d0a-499d-92ce-af33a1fdcfd3 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:12.956788 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-a2ae7ef6-0d0a-499d-92ce-af33a1fdcfd3 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:12.964937 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-a2ae7ef6-0d0a-499d-92ce-af33a1fdcfd3 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1575 microversion: 2.1 time: 0.159193 Jun 03 10:05:12.965719 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 453/890] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:12 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:13.981313 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-8ff53714-3c9e-4805-ab20-892ef7c829bd tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:13.981934 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-8ff53714-3c9e-4805-ab20-892ef7c829bd tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:13.988502 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8ff53714-3c9e-4805-ab20-892ef7c829bd tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:13.988949 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8ff53714-3c9e-4805-ab20-892ef7c829bd tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:13.989713 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8ff53714-3c9e-4805-ab20-892ef7c829bd tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:13.990165 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8ff53714-3c9e-4805-ab20-892ef7c829bd tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:14.196179 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-8ff53714-3c9e-4805-ab20-892ef7c829bd tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:14.204148 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-8ff53714-3c9e-4805-ab20-892ef7c829bd tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1575 microversion: 2.1 time: 0.226781 Jun 03 10:05:14.204800 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 438/891] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:13 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1575 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:15.221472 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-eaad1993-b2a0-41f6-b05f-2cc6bf8f9caf tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:15.222110 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-eaad1993-b2a0-41f6-b05f-2cc6bf8f9caf tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:15.228870 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-eaad1993-b2a0-41f6-b05f-2cc6bf8f9caf tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:15.229319 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-eaad1993-b2a0-41f6-b05f-2cc6bf8f9caf tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:15.230112 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-eaad1993-b2a0-41f6-b05f-2cc6bf8f9caf tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:15.230545 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-eaad1993-b2a0-41f6-b05f-2cc6bf8f9caf tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:15.368171 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-eaad1993-b2a0-41f6-b05f-2cc6bf8f9caf tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:15.376094 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-eaad1993-b2a0-41f6-b05f-2cc6bf8f9caf tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1575 microversion: 2.1 time: 0.159409 Jun 03 10:05:15.376665 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 454/892] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:15 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:15.445735 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-59e2613a-52cb-4be3-bd4a-6cdd2562eceb req-a02372b6-a004-4c13-9fc8-42794070def3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5afad0ea-b328-43cf-8ed2-f500796569b0", "name": "network-vif-plugged", "status": "completed", "tag": "895de58e-9396-45ee-adb3-b1ce59bb1799"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:05:15.456212 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-59e2613a-52cb-4be3-bd4a-6cdd2562eceb req-a02372b6-a004-4c13-9fc8-42794070def3 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:15.456649 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-59e2613a-52cb-4be3-bd4a-6cdd2562eceb req-a02372b6-a004-4c13-9fc8-42794070def3 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:15.467785 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-59e2613a-52cb-4be3-bd4a-6cdd2562eceb req-a02372b6-a004-4c13-9fc8-42794070def3 service nova] Creating event network-vif-plugged:895de58e-9396-45ee-adb3-b1ce59bb1799 for instance 5afad0ea-b328-43cf-8ed2-f500796569b0 on hv-cinder-84456 Jun 03 10:05:15.472873 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-59e2613a-52cb-4be3-bd4a-6cdd2562eceb req-a02372b6-a004-4c13-9fc8-42794070def3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033393 Jun 03 10:05:15.473464 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 439/893] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:05:16.394032 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-212f88cb-ca00-429b-a37f-ed58795e08ac tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:16.394647 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-212f88cb-ca00-429b-a37f-ed58795e08ac tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:16.401320 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-212f88cb-ca00-429b-a37f-ed58795e08ac tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:16.401773 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-212f88cb-ca00-429b-a37f-ed58795e08ac tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:16.402568 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-212f88cb-ca00-429b-a37f-ed58795e08ac tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:16.403005 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-212f88cb-ca00-429b-a37f-ed58795e08ac tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:16.535733 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-212f88cb-ca00-429b-a37f-ed58795e08ac tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:16.543299 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-212f88cb-ca00-429b-a37f-ed58795e08ac tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1575 microversion: 2.1 time: 0.153166 Jun 03 10:05:16.543870 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 455/894] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:16 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:16.679864 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-deb60b1a-808c-4c6f-87f7-a4583fb00495 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:16.680864 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-deb60b1a-808c-4c6f-87f7-a4583fb00495 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:16.687483 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-deb60b1a-808c-4c6f-87f7-a4583fb00495 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:16.687936 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-deb60b1a-808c-4c6f-87f7-a4583fb00495 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:16.688709 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-deb60b1a-808c-4c6f-87f7-a4583fb00495 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:16.689165 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-deb60b1a-808c-4c6f-87f7-a4583fb00495 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:16.723940 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-deb60b1a-808c-4c6f-87f7-a4583fb00495 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048244 Jun 03 10:05:16.724518 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 440/895] 10.222.0.42 () {60 vars in 1342 bytes} [Fri Jun 3 10:05:16 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:16.783576 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-e5a54da1-357d-4d6c-9142-4cc8a93edc3a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:16.784083 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-e5a54da1-357d-4d6c-9142-4cc8a93edc3a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:16.789995 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e5a54da1-357d-4d6c-9142-4cc8a93edc3a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:16.790446 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e5a54da1-357d-4d6c-9142-4cc8a93edc3a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:16.791203 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e5a54da1-357d-4d6c-9142-4cc8a93edc3a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:16.791630 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e5a54da1-357d-4d6c-9142-4cc8a93edc3a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:16.816604 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-e5a54da1-357d-4d6c-9142-4cc8a93edc3a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Going to try to terminate instance {{(pid=125065) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:05:17.163508 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-e5a54da1-357d-4d6c-9142-4cc8a93edc3a tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 204 len: 0 microversion: 2.20 time: 0.384259 Jun 03 10:05:17.164133 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 456/896] 10.222.0.42 () {60 vars in 1279 bytes} [Fri Jun 3 10:05:16 2022] DELETE /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 03 10:05:17.172463 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-9db7b207-07f1-4b53-896c-6a4014402b55 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:17.173105 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-9db7b207-07f1-4b53-896c-6a4014402b55 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:17.179417 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9db7b207-07f1-4b53-896c-6a4014402b55 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:17.179813 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9db7b207-07f1-4b53-896c-6a4014402b55 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:17.180569 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9db7b207-07f1-4b53-896c-6a4014402b55 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:17.181007 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9db7b207-07f1-4b53-896c-6a4014402b55 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:17.315405 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-9db7b207-07f1-4b53-896c-6a4014402b55 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:17.323299 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-9db7b207-07f1-4b53-896c-6a4014402b55 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:17.324782 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-9db7b207-07f1-4b53-896c-6a4014402b55 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:17.326039 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-9db7b207-07f1-4b53-896c-6a4014402b55 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1725 microversion: 2.20 time: 0.157659 Jun 03 10:05:17.326592 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 441/897] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:05:17 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:05:17.561122 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-076e7369-a44d-4240-8ab7-3c7267789964 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:17.561928 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-076e7369-a44d-4240-8ab7-3c7267789964 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:17.569148 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-076e7369-a44d-4240-8ab7-3c7267789964 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:17.570666 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-076e7369-a44d-4240-8ab7-3c7267789964 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:17.570666 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-076e7369-a44d-4240-8ab7-3c7267789964 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:17.571035 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-076e7369-a44d-4240-8ab7-3c7267789964 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:17.742996 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-076e7369-a44d-4240-8ab7-3c7267789964 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:17.751715 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-076e7369-a44d-4240-8ab7-3c7267789964 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1562 microversion: 2.1 time: 0.195058 Jun 03 10:05:17.752298 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 457/898] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:17 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1562 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:18.344436 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-95c02ad4-1cdc-4d9c-914e-ae593259f89b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:18.345043 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-95c02ad4-1cdc-4d9c-914e-ae593259f89b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:18.352120 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-95c02ad4-1cdc-4d9c-914e-ae593259f89b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:18.354548 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-95c02ad4-1cdc-4d9c-914e-ae593259f89b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:18.354548 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-95c02ad4-1cdc-4d9c-914e-ae593259f89b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:18.354548 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-95c02ad4-1cdc-4d9c-914e-ae593259f89b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:18.498337 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-95c02ad4-1cdc-4d9c-914e-ae593259f89b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:18.506895 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-95c02ad4-1cdc-4d9c-914e-ae593259f89b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:18.508661 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-95c02ad4-1cdc-4d9c-914e-ae593259f89b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:18.509839 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-95c02ad4-1cdc-4d9c-914e-ae593259f89b tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1725 microversion: 2.20 time: 0.169283 Jun 03 10:05:18.510430 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 442/899] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:05:18 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:05:19.528600 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-f3be5b65-ac2f-4a4c-ad14-f4c05c9377a3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:19.529269 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-f3be5b65-ac2f-4a4c-ad14-f4c05c9377a3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:19.532183 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:19.537484 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f3be5b65-ac2f-4a4c-ad14-f4c05c9377a3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:19.538277 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f3be5b65-ac2f-4a4c-ad14-f4c05c9377a3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:19.539153 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f3be5b65-ac2f-4a4c-ad14-f4c05c9377a3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:19.539650 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f3be5b65-ac2f-4a4c-ad14-f4c05c9377a3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:19.887735 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f3be5b65-ac2f-4a4c-ad14-f4c05c9377a3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:19.895782 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f3be5b65-ac2f-4a4c-ad14-f4c05c9377a3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:19.897301 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f3be5b65-ac2f-4a4c-ad14-f4c05c9377a3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:19.898576 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-f3be5b65-ac2f-4a4c-ad14-f4c05c9377a3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1725 microversion: 2.20 time: 0.374126 Jun 03 10:05:19.899138 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 458/900] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:05:19 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1725 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:05:20.564027 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-a168b8a3-cd05-4e78-a6ad-4894b0e88153 req-acaaff78-ca4f-4ad1-a0c9-286c3f4d0c93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc", "name": "network-vif-deleted", "tag": "3b6360f1-9329-469d-913b-3b05fed8cd88"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:05:20.576482 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-a168b8a3-cd05-4e78-a6ad-4894b0e88153 req-acaaff78-ca4f-4ad1-a0c9-286c3f4d0c93 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:20.577787 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-a168b8a3-cd05-4e78-a6ad-4894b0e88153 req-acaaff78-ca4f-4ad1-a0c9-286c3f4d0c93 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:20.609708 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-a168b8a3-cd05-4e78-a6ad-4894b0e88153 req-acaaff78-ca4f-4ad1-a0c9-286c3f4d0c93 service nova] Creating event network-vif-deleted:3b6360f1-9329-469d-913b-3b05fed8cd88 for instance a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc on hv-cinder-84456 Jun 03 10:05:20.620490 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-a168b8a3-cd05-4e78-a6ad-4894b0e88153 req-acaaff78-ca4f-4ad1-a0c9-286c3f4d0c93 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062135 Jun 03 10:05:20.621449 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 443/901] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:05:20.917414 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-bfb076cb-364c-4352-ba33-6f89f20593b4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:20.918099 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-bfb076cb-364c-4352-ba33-6f89f20593b4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:20.925632 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-bfb076cb-364c-4352-ba33-6f89f20593b4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:20.926123 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-bfb076cb-364c-4352-ba33-6f89f20593b4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:20.931471 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-bfb076cb-364c-4352-ba33-6f89f20593b4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:20.931471 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-bfb076cb-364c-4352-ba33-6f89f20593b4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:20.960768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-bfb076cb-364c-4352-ba33-6f89f20593b4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:20.961222 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-bfb076cb-364c-4352-ba33-6f89f20593b4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:20.961682 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.objects.instance [None req-bfb076cb-364c-4352-ba33-6f89f20593b4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lazy-loading 'fault' on Instance uuid a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc {{(pid=125065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:05:21.006553 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-bfb076cb-364c-4352-ba33-6f89f20593b4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:21.017532 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-bfb076cb-364c-4352-ba33-6f89f20593b4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:21.020532 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-bfb076cb-364c-4352-ba33-6f89f20593b4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a304d58eff84a87953dc7af6a0afe87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57756244f164417dad785bb5927d05b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:21.022201 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-bfb076cb-364c-4352-ba33-6f89f20593b4 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 200 len: 1372 microversion: 2.20 time: 0.108546 Jun 03 10:05:21.031954 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 459/902] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:05:20 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:05:22.040163 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-fd55d172-1805-486a-8f99-75055a1f9a59 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:22.040890 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-fd55d172-1805-486a-8f99-75055a1f9a59 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:22.043577 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:22.048674 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fd55d172-1805-486a-8f99-75055a1f9a59 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:22.049127 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fd55d172-1805-486a-8f99-75055a1f9a59 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:22.049907 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fd55d172-1805-486a-8f99-75055a1f9a59 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:22.050352 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fd55d172-1805-486a-8f99-75055a1f9a59 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:22.063523 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.wsgi [None req-fd55d172-1805-486a-8f99-75055a1f9a59 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] HTTP exception thrown: Instance a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc could not be found. Jun 03 10:05:22.065139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-fd55d172-1805-486a-8f99-75055a1f9a59 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Request method failure captured: Jun 03 10:05:22.065139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: request: GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc HTTP/1.1 Jun 03 10:05:22.065139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept: application/json Jun 03 10:05:22.065139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept-Encoding: identity Jun 03 10:05:22.065139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Connection: close Jun 03 10:05:22.065139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Length: 0 Jun 03 10:05:22.065139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Type: application/json Jun 03 10:05:22.065139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Host: 10.222.0.42 Jun 03 10:05:22.065139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Openstack-System-Scope: None Jun 03 10:05:22.065139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: User-Agent: python-urllib3/1.26.9 Jun 03 10:05:22.065139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Auth-Token: gAAAAABimdtDyYEJ77YsGiOuv1BqHCLCT-FQnnFwcIg64gFxPxCelCnyjijn2-o4KWcqHOUg5cSOqXP30EE03kvtu0gESwuB2N-uvNGBuvh6Wre5iHjsBgAKH6a0r9Z7M5bYmRLTYTbv7Jg4IfzYVhE4gtvjy0zjIWDPmQjSXHde_X_80fn1dB0 Jun 03 10:05:22.065139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Id: None Jun 03 10:05:22.065139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Name: None Jun 03 10:05:22.065139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Identity-Status: Confirmed Jun 03 10:05:22.065139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Is-Admin-Project: True Jun 03 10:05:22.065139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 10:05:22.065139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Id: default Jun 03 10:05:22.065139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Name: Default Jun 03 10:05:22.065139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Id: 57756244f164417dad785bb5927d05b6 Jun 03 10:05:22.065139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1243409567 Jun 03 10:05:22.065139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Role: member,reader Jun 03 10:05:22.065139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Roles: member,reader Jun 03 10:05:22.067421 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/57756244f164417dad785bb5927d05b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/57756244f164417dad785bb5927d05b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_57756244f164417dad785bb5927d05b6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/57756244f164417dad785bb5927d05b6"}]}] Jun 03 10:05:22.067421 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1243409567 Jun 03 10:05:22.067421 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Id: 57756244f164417dad785bb5927d05b6 Jun 03 10:05:22.067421 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1243409567 Jun 03 10:05:22.067421 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User: tempest-AttachVolumeShelveTestJSON-1243409567-project Jun 03 10:05:22.067421 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Id: default Jun 03 10:05:22.067421 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Name: Default Jun 03 10:05:22.067421 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Id: 5a304d58eff84a87953dc7af6a0afe87 Jun 03 10:05:22.067421 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1243409567-project Jun 03 10:05:22.067421 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: method: > Jun 03 10:05:22.067421 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: exception: Instance a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc could not be found. Jun 03 10:05:22.067421 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: action_args: {'id': 'a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc'} Jun 03 10:05:22.068337 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:05:22.068337 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:22.068337 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:05:22.068337 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:05:22.068337 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:05:22.068337 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:05:22.068337 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:05:22.068337 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:05:22.068337 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:05:22.068337 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:05:22.068337 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc could not be found. Jun 03 10:05:22.068337 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:05:22.068337 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:05:22.068337 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:05:22.068337 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:22.068337 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:05:22.068337 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:05:22.068337 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:05:22.068337 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:05:22.068337 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:05:22.069932 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:05:22.069932 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:05:22.069932 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:05:22.069932 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:05:22.069932 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:05:22.069932 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:05:22.069932 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:05:22.069932 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc could not be found. Jun 03 10:05:22.069932 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:05:22.069932 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:05:22.069932 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:05:22.069932 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:22.069932 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:05:22.069932 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:05:22.069932 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:05:22.069932 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:05:22.069932 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc could not be found. Jun 03 10:05:22.069932 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:05:22.071308 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-fd55d172-1805-486a-8f99-75055a1f9a59 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Returning 404 to user: Instance a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc could not be found. {{(pid=125066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:05:22.071308 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-fd55d172-1805-486a-8f99-75055a1f9a59 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 404 len: 111 microversion: 2.20 time: 0.030650 Jun 03 10:05:22.071308 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 444/903] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:05:22 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 10:05:22.076140 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-4dc39906-4b57-44b6-bf01-f8a545c03ba3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '.version_select at 0x7f8d23628700>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:22.233043 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-4dc39906-4b57-44b6-bf01-f8a545c03ba3 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1158113069" status: 204 len: 0 microversion: 2.20 time: 0.160693 Jun 03 10:05:22.233694 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 460/904] 10.222.0.42 () {60 vars in 1261 bytes} [Fri Jun 3 10:05:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1158113069 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 03 10:05:24.239682 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-17f363e9-74f9-486d-a25f-5f990cd696bb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:24.240168 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-17f363e9-74f9-486d-a25f-5f990cd696bb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:24.247382 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-17f363e9-74f9-486d-a25f-5f990cd696bb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:24.247829 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-17f363e9-74f9-486d-a25f-5f990cd696bb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:24.248591 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-17f363e9-74f9-486d-a25f-5f990cd696bb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:24.249025 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-17f363e9-74f9-486d-a25f-5f990cd696bb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:24.263107 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.wsgi [None req-17f363e9-74f9-486d-a25f-5f990cd696bb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] HTTP exception thrown: Instance a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc could not be found. Jun 03 10:05:24.264676 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-17f363e9-74f9-486d-a25f-5f990cd696bb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Request method failure captured: Jun 03 10:05:24.264676 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: request: DELETE /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc HTTP/1.1 Jun 03 10:05:24.264676 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept: application/json Jun 03 10:05:24.264676 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept-Encoding: identity Jun 03 10:05:24.264676 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Connection: close Jun 03 10:05:24.264676 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Length: 0 Jun 03 10:05:24.264676 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Type: application/json Jun 03 10:05:24.264676 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Host: 10.222.0.42 Jun 03 10:05:24.264676 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Openstack-System-Scope: None Jun 03 10:05:24.264676 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: User-Agent: python-urllib3/1.26.9 Jun 03 10:05:24.264676 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Auth-Token: gAAAAABimdtDyYEJ77YsGiOuv1BqHCLCT-FQnnFwcIg64gFxPxCelCnyjijn2-o4KWcqHOUg5cSOqXP30EE03kvtu0gESwuB2N-uvNGBuvh6Wre5iHjsBgAKH6a0r9Z7M5bYmRLTYTbv7Jg4IfzYVhE4gtvjy0zjIWDPmQjSXHde_X_80fn1dB0 Jun 03 10:05:24.264676 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Id: None Jun 03 10:05:24.264676 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Name: None Jun 03 10:05:24.264676 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Identity-Status: Confirmed Jun 03 10:05:24.264676 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Is-Admin-Project: True Jun 03 10:05:24.264676 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 10:05:24.264676 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Id: default Jun 03 10:05:24.264676 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Name: Default Jun 03 10:05:24.264676 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Id: 57756244f164417dad785bb5927d05b6 Jun 03 10:05:24.264676 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1243409567 Jun 03 10:05:24.264676 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Role: member,reader Jun 03 10:05:24.264676 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Roles: member,reader Jun 03 10:05:24.266426 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/57756244f164417dad785bb5927d05b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/57756244f164417dad785bb5927d05b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_57756244f164417dad785bb5927d05b6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/57756244f164417dad785bb5927d05b6"}]}] Jun 03 10:05:24.266426 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1243409567 Jun 03 10:05:24.266426 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Id: 57756244f164417dad785bb5927d05b6 Jun 03 10:05:24.266426 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1243409567 Jun 03 10:05:24.266426 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User: tempest-AttachVolumeShelveTestJSON-1243409567-project Jun 03 10:05:24.266426 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Id: default Jun 03 10:05:24.266426 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Name: Default Jun 03 10:05:24.266426 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Id: 5a304d58eff84a87953dc7af6a0afe87 Jun 03 10:05:24.266426 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1243409567-project Jun 03 10:05:24.266426 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: method: > Jun 03 10:05:24.266426 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: exception: Instance a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc could not be found. Jun 03 10:05:24.266426 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: action_args: {'id': 'a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc'} Jun 03 10:05:24.267347 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:05:24.267347 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:24.267347 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:05:24.267347 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:05:24.267347 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:05:24.267347 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:05:24.267347 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:05:24.267347 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:05:24.267347 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:05:24.267347 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:05:24.267347 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc could not be found. Jun 03 10:05:24.267347 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:05:24.267347 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:05:24.267347 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:05:24.267347 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:24.267347 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:05:24.267347 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:05:24.267347 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:05:24.267347 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:05:24.267347 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:05:24.268850 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:05:24.268850 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 10:05:24.268850 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 10:05:24.268850 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 10:05:24.268850 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 10:05:24.268850 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:05:24.268850 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:05:24.268850 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:05:24.268850 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:05:24.268850 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc could not be found. Jun 03 10:05:24.268850 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:05:24.268850 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:05:24.268850 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:05:24.268850 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:24.268850 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:05:24.268850 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:05:24.268850 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:05:24.268850 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:05:24.268850 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc could not be found. Jun 03 10:05:24.268850 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:05:24.270465 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-17f363e9-74f9-486d-a25f-5f990cd696bb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Returning 404 to user: Instance a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc could not be found. {{(pid=125066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:05:24.270465 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-17f363e9-74f9-486d-a25f-5f990cd696bb tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 404 len: 111 microversion: 2.20 time: 0.030330 Jun 03 10:05:24.270465 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 445/905] 10.222.0.42 () {60 vars in 1279 bytes} [Fri Jun 3 10:05:24 2022] DELETE /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 10:05:24.275790 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-38490810-d30a-4d80-86aa-5d36b606e506 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:24.282823 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-38490810-d30a-4d80-86aa-5d36b606e506 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:24.283013 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-38490810-d30a-4d80-86aa-5d36b606e506 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:24.283461 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-38490810-d30a-4d80-86aa-5d36b606e506 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:24.284210 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-38490810-d30a-4d80-86aa-5d36b606e506 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:24.284643 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-38490810-d30a-4d80-86aa-5d36b606e506 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:24.297867 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.wsgi [None req-38490810-d30a-4d80-86aa-5d36b606e506 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] HTTP exception thrown: Instance a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc could not be found. Jun 03 10:05:24.299561 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-38490810-d30a-4d80-86aa-5d36b606e506 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Request method failure captured: Jun 03 10:05:24.299561 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: request: GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc HTTP/1.1 Jun 03 10:05:24.299561 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept: application/json Jun 03 10:05:24.299561 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept-Encoding: identity Jun 03 10:05:24.299561 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Connection: close Jun 03 10:05:24.299561 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Length: 0 Jun 03 10:05:24.299561 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Type: application/json Jun 03 10:05:24.299561 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Host: 10.222.0.42 Jun 03 10:05:24.299561 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Openstack-System-Scope: None Jun 03 10:05:24.299561 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: User-Agent: python-urllib3/1.26.9 Jun 03 10:05:24.299561 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Auth-Token: gAAAAABimdtDyYEJ77YsGiOuv1BqHCLCT-FQnnFwcIg64gFxPxCelCnyjijn2-o4KWcqHOUg5cSOqXP30EE03kvtu0gESwuB2N-uvNGBuvh6Wre5iHjsBgAKH6a0r9Z7M5bYmRLTYTbv7Jg4IfzYVhE4gtvjy0zjIWDPmQjSXHde_X_80fn1dB0 Jun 03 10:05:24.299561 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Id: None Jun 03 10:05:24.299561 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Name: None Jun 03 10:05:24.299561 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Identity-Status: Confirmed Jun 03 10:05:24.299561 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Is-Admin-Project: True Jun 03 10:05:24.299561 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 10:05:24.299561 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Id: default Jun 03 10:05:24.299561 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Name: Default Jun 03 10:05:24.299561 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Id: 57756244f164417dad785bb5927d05b6 Jun 03 10:05:24.299561 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1243409567 Jun 03 10:05:24.299561 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Role: member,reader Jun 03 10:05:24.299561 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Roles: member,reader Jun 03 10:05:24.301330 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/57756244f164417dad785bb5927d05b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/57756244f164417dad785bb5927d05b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_57756244f164417dad785bb5927d05b6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/57756244f164417dad785bb5927d05b6"}]}] Jun 03 10:05:24.301330 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1243409567 Jun 03 10:05:24.301330 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Id: 57756244f164417dad785bb5927d05b6 Jun 03 10:05:24.301330 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1243409567 Jun 03 10:05:24.301330 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User: tempest-AttachVolumeShelveTestJSON-1243409567-project Jun 03 10:05:24.301330 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Id: default Jun 03 10:05:24.301330 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Name: Default Jun 03 10:05:24.301330 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Id: 5a304d58eff84a87953dc7af6a0afe87 Jun 03 10:05:24.301330 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1243409567-project Jun 03 10:05:24.301330 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: method: > Jun 03 10:05:24.301330 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: exception: Instance a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc could not be found. Jun 03 10:05:24.301330 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: action_args: {'id': 'a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc'} Jun 03 10:05:24.303011 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:05:24.303011 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:24.303011 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:05:24.303011 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:05:24.303011 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:05:24.303011 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:05:24.303011 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:05:24.303011 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:05:24.303011 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:05:24.303011 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:05:24.303011 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc could not be found. Jun 03 10:05:24.303011 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:05:24.303011 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:05:24.303011 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:05:24.303011 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:24.303011 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:05:24.303011 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:05:24.303011 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:05:24.303011 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:05:24.303011 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:05:24.304455 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:05:24.304455 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:05:24.304455 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:05:24.304455 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:05:24.304455 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:05:24.304455 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:05:24.304455 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:05:24.304455 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc could not be found. Jun 03 10:05:24.304455 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:05:24.304455 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:05:24.304455 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:05:24.304455 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:24.304455 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:05:24.304455 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:05:24.304455 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:05:24.304455 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:05:24.304455 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc could not be found. Jun 03 10:05:24.304455 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:05:24.305751 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-38490810-d30a-4d80-86aa-5d36b606e506 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Returning 404 to user: Instance a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc could not be found. {{(pid=125065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:05:24.305751 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-38490810-d30a-4d80-86aa-5d36b606e506 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc" status: 404 len: 111 microversion: 2.20 time: 0.030163 Jun 03 10:05:24.305751 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 461/906] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:05:24 2022] GET /compute/v2.1/servers/a58dc7b8-77b2-48f5-b61e-0d2eeb0a7bdc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 10:05:25.605627 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-7545b6a8-c4e3-475e-8fe1-1d19ced71cdf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:25.606171 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-7545b6a8-c4e3-475e-8fe1-1d19ced71cdf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:25.612835 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7545b6a8-c4e3-475e-8fe1-1d19ced71cdf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:25.613317 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7545b6a8-c4e3-475e-8fe1-1d19ced71cdf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:25.614115 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7545b6a8-c4e3-475e-8fe1-1d19ced71cdf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:25.614556 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7545b6a8-c4e3-475e-8fe1-1d19ced71cdf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:25.628115 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.wsgi [None req-7545b6a8-c4e3-475e-8fe1-1d19ced71cdf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] HTTP exception thrown: Instance 6517823d-711a-4e24-9cdf-27812d522a46 could not be found. Jun 03 10:05:25.629790 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-7545b6a8-c4e3-475e-8fe1-1d19ced71cdf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Request method failure captured: Jun 03 10:05:25.629790 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: request: DELETE /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 HTTP/1.1 Jun 03 10:05:25.629790 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept: application/json Jun 03 10:05:25.629790 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept-Encoding: identity Jun 03 10:05:25.629790 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Connection: close Jun 03 10:05:25.629790 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Length: 0 Jun 03 10:05:25.629790 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Type: application/json Jun 03 10:05:25.629790 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Host: 10.222.0.42 Jun 03 10:05:25.629790 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Openstack-System-Scope: None Jun 03 10:05:25.629790 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: User-Agent: python-urllib3/1.26.9 Jun 03 10:05:25.629790 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Auth-Token: gAAAAABimdtDyYEJ77YsGiOuv1BqHCLCT-FQnnFwcIg64gFxPxCelCnyjijn2-o4KWcqHOUg5cSOqXP30EE03kvtu0gESwuB2N-uvNGBuvh6Wre5iHjsBgAKH6a0r9Z7M5bYmRLTYTbv7Jg4IfzYVhE4gtvjy0zjIWDPmQjSXHde_X_80fn1dB0 Jun 03 10:05:25.629790 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Id: None Jun 03 10:05:25.629790 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Name: None Jun 03 10:05:25.629790 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Identity-Status: Confirmed Jun 03 10:05:25.629790 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Is-Admin-Project: True Jun 03 10:05:25.629790 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 10:05:25.629790 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Id: default Jun 03 10:05:25.629790 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Name: Default Jun 03 10:05:25.629790 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Id: 57756244f164417dad785bb5927d05b6 Jun 03 10:05:25.629790 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1243409567 Jun 03 10:05:25.629790 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Role: member,reader Jun 03 10:05:25.629790 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Roles: member,reader Jun 03 10:05:25.631348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/57756244f164417dad785bb5927d05b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/57756244f164417dad785bb5927d05b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_57756244f164417dad785bb5927d05b6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/57756244f164417dad785bb5927d05b6"}]}] Jun 03 10:05:25.631348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1243409567 Jun 03 10:05:25.631348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Id: 57756244f164417dad785bb5927d05b6 Jun 03 10:05:25.631348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1243409567 Jun 03 10:05:25.631348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User: tempest-AttachVolumeShelveTestJSON-1243409567-project Jun 03 10:05:25.631348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Id: default Jun 03 10:05:25.631348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Name: Default Jun 03 10:05:25.631348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Id: 5a304d58eff84a87953dc7af6a0afe87 Jun 03 10:05:25.631348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1243409567-project Jun 03 10:05:25.631348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: method: > Jun 03 10:05:25.631348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: exception: Instance 6517823d-711a-4e24-9cdf-27812d522a46 could not be found. Jun 03 10:05:25.631348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: action_args: {'id': '6517823d-711a-4e24-9cdf-27812d522a46'} Jun 03 10:05:25.632182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:05:25.632182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:25.632182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:05:25.632182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:05:25.632182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:05:25.632182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:05:25.632182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:05:25.632182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:05:25.632182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:05:25.632182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:05:25.632182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6517823d-711a-4e24-9cdf-27812d522a46 could not be found. Jun 03 10:05:25.632182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:05:25.632182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:05:25.632182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:05:25.632182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:25.632182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:05:25.632182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:05:25.632182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:05:25.632182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:05:25.632182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:05:25.633876 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:05:25.633876 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 10:05:25.633876 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 10:05:25.633876 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 10:05:25.633876 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 10:05:25.633876 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:05:25.633876 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:05:25.633876 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:05:25.633876 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:05:25.633876 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6517823d-711a-4e24-9cdf-27812d522a46 could not be found. Jun 03 10:05:25.633876 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:05:25.633876 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:05:25.633876 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:05:25.633876 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:25.633876 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:05:25.633876 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:05:25.633876 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:05:25.633876 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:05:25.633876 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6517823d-711a-4e24-9cdf-27812d522a46 could not be found. Jun 03 10:05:25.633876 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:05:25.635399 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-7545b6a8-c4e3-475e-8fe1-1d19ced71cdf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Returning 404 to user: Instance 6517823d-711a-4e24-9cdf-27812d522a46 could not be found. {{(pid=125066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:05:25.635399 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-7545b6a8-c4e3-475e-8fe1-1d19ced71cdf tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 404 len: 111 microversion: 2.20 time: 0.030529 Jun 03 10:05:25.635651 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 446/907] 10.222.0.42 () {60 vars in 1279 bytes} [Fri Jun 3 10:05:25 2022] DELETE /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 10:05:25.640626 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-3ea7846e-9ee7-412e-a51f-666047f58cc0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:25.641228 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-3ea7846e-9ee7-412e-a51f-666047f58cc0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] [instance: 6517823d-711a-4e24-9cdf-27812d522a46] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:25.648528 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3ea7846e-9ee7-412e-a51f-666047f58cc0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:25.648985 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3ea7846e-9ee7-412e-a51f-666047f58cc0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:25.649765 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3ea7846e-9ee7-412e-a51f-666047f58cc0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:25.650316 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3ea7846e-9ee7-412e-a51f-666047f58cc0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:25.664692 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.wsgi [None req-3ea7846e-9ee7-412e-a51f-666047f58cc0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] HTTP exception thrown: Instance 6517823d-711a-4e24-9cdf-27812d522a46 could not be found. Jun 03 10:05:25.666203 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-3ea7846e-9ee7-412e-a51f-666047f58cc0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Request method failure captured: Jun 03 10:05:25.666203 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: request: GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 HTTP/1.1 Jun 03 10:05:25.666203 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept: application/json Jun 03 10:05:25.666203 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept-Encoding: identity Jun 03 10:05:25.666203 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Connection: close Jun 03 10:05:25.666203 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Length: 0 Jun 03 10:05:25.666203 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Type: application/json Jun 03 10:05:25.666203 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Host: 10.222.0.42 Jun 03 10:05:25.666203 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Openstack-System-Scope: None Jun 03 10:05:25.666203 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: User-Agent: python-urllib3/1.26.9 Jun 03 10:05:25.666203 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Auth-Token: gAAAAABimdtDyYEJ77YsGiOuv1BqHCLCT-FQnnFwcIg64gFxPxCelCnyjijn2-o4KWcqHOUg5cSOqXP30EE03kvtu0gESwuB2N-uvNGBuvh6Wre5iHjsBgAKH6a0r9Z7M5bYmRLTYTbv7Jg4IfzYVhE4gtvjy0zjIWDPmQjSXHde_X_80fn1dB0 Jun 03 10:05:25.666203 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Id: None Jun 03 10:05:25.666203 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Name: None Jun 03 10:05:25.666203 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Identity-Status: Confirmed Jun 03 10:05:25.666203 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Is-Admin-Project: True Jun 03 10:05:25.666203 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 10:05:25.666203 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Id: default Jun 03 10:05:25.666203 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Name: Default Jun 03 10:05:25.666203 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Id: 57756244f164417dad785bb5927d05b6 Jun 03 10:05:25.666203 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1243409567 Jun 03 10:05:25.666203 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Role: member,reader Jun 03 10:05:25.666203 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Roles: member,reader Jun 03 10:05:25.667792 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/57756244f164417dad785bb5927d05b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/57756244f164417dad785bb5927d05b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_57756244f164417dad785bb5927d05b6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/57756244f164417dad785bb5927d05b6"}]}] Jun 03 10:05:25.667792 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1243409567 Jun 03 10:05:25.667792 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Id: 57756244f164417dad785bb5927d05b6 Jun 03 10:05:25.667792 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1243409567 Jun 03 10:05:25.667792 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User: tempest-AttachVolumeShelveTestJSON-1243409567-project Jun 03 10:05:25.667792 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Id: default Jun 03 10:05:25.667792 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Name: Default Jun 03 10:05:25.667792 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Id: 5a304d58eff84a87953dc7af6a0afe87 Jun 03 10:05:25.667792 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1243409567-project Jun 03 10:05:25.667792 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: method: > Jun 03 10:05:25.667792 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: exception: Instance 6517823d-711a-4e24-9cdf-27812d522a46 could not be found. Jun 03 10:05:25.667792 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: action_args: {'id': '6517823d-711a-4e24-9cdf-27812d522a46'} Jun 03 10:05:25.668637 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:05:25.668637 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:25.668637 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:05:25.668637 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:05:25.668637 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:05:25.668637 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:05:25.668637 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:05:25.668637 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:05:25.668637 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:05:25.668637 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:05:25.668637 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6517823d-711a-4e24-9cdf-27812d522a46 could not be found. Jun 03 10:05:25.668637 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:05:25.668637 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:05:25.668637 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:05:25.668637 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:25.668637 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:05:25.668637 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:05:25.668637 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:05:25.668637 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:05:25.668637 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:05:25.670074 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:05:25.670074 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:05:25.670074 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:05:25.670074 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:05:25.670074 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:05:25.670074 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:05:25.670074 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:05:25.670074 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6517823d-711a-4e24-9cdf-27812d522a46 could not be found. Jun 03 10:05:25.670074 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:05:25.670074 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:05:25.670074 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:05:25.670074 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:25.670074 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:05:25.670074 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:05:25.670074 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:05:25.670074 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:05:25.670074 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6517823d-711a-4e24-9cdf-27812d522a46 could not be found. Jun 03 10:05:25.670074 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:05:25.671363 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-3ea7846e-9ee7-412e-a51f-666047f58cc0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] Returning 404 to user: Instance 6517823d-711a-4e24-9cdf-27812d522a46 could not be found. {{(pid=125065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:05:25.671363 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-3ea7846e-9ee7-412e-a51f-666047f58cc0 tempest-AttachVolumeShelveTestJSON-1243409567 tempest-AttachVolumeShelveTestJSON-1243409567-project] 10.222.0.42 "GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46" status: 404 len: 111 microversion: 2.20 time: 0.030853 Jun 03 10:05:25.671363 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 462/908] 10.222.0.42 () {60 vars in 1276 bytes} [Fri Jun 3 10:05:25 2022] GET /compute/v2.1/servers/6517823d-711a-4e24-9cdf-27812d522a46 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 10:05:55.118268 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-3bc1de1b-16eb-41cc-a4f6-f8a48a274e53 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:55.118783 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-3bc1de1b-16eb-41cc-a4f6-f8a48a274e53 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: aa10760a-d45e-497a-8f67-9cd6ed2eb585] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:55.121072 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_api:SELECT=5 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:55.121701 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:SELECT=93 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:55.126572 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3bc1de1b-16eb-41cc-a4f6-f8a48a274e53 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:55.127022 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3bc1de1b-16eb-41cc-a4f6-f8a48a274e53 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:55.127777 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3bc1de1b-16eb-41cc-a4f6-f8a48a274e53 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:55.128375 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3bc1de1b-16eb-41cc-a4f6-f8a48a274e53 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:55.155834 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-3bc1de1b-16eb-41cc-a4f6-f8a48a274e53 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585/ips" status: 200 len: 149 microversion: 2.1 time: 0.041496 Jun 03 10:05:55.161688 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 447/909] 10.222.0.42 () {58 vars in 1247 bytes} [Fri Jun 3 10:05:55 2022] GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:05:55.167524 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-9b6d27b2-6b34-4879-8e3d-5e7fb8ab0627 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36329aa3-1fe5-4c8d-a62c-8b8c0d1e260b"}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:05:55.168813 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-9b6d27b2-6b34-4879-8e3d-5e7fb8ab0627 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: aa10760a-d45e-497a-8f67-9cd6ed2eb585] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:55.174642 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:55.175359 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:55.176786 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9b6d27b2-6b34-4879-8e3d-5e7fb8ab0627 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:55.177300 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9b6d27b2-6b34-4879-8e3d-5e7fb8ab0627 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:55.178124 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9b6d27b2-6b34-4879-8e3d-5e7fb8ab0627 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:55.178565 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9b6d27b2-6b34-4879-8e3d-5e7fb8ab0627 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:55.259346 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.wsgi [None req-9b6d27b2-6b34-4879-8e3d-5e7fb8ab0627 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] HTTP exception thrown: Invalid volume: volume 36329aa3-1fe5-4c8d-a62c-8b8c0d1e260b is already attached to instances: 17b2f507-9340-486f-92ed-d249b5b78d78 Jun 03 10:05:55.260997 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-9b6d27b2-6b34-4879-8e3d-5e7fb8ab0627 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Request method failure captured: Jun 03 10:05:55.260997 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: request: POST /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585/os-volume_attachments HTTP/1.1 Jun 03 10:05:55.260997 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept: application/json Jun 03 10:05:55.260997 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept-Encoding: identity Jun 03 10:05:55.260997 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Connection: close Jun 03 10:05:55.260997 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Length: 74 Jun 03 10:05:55.260997 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Type: application/json Jun 03 10:05:55.260997 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Host: 10.222.0.42 Jun 03 10:05:55.260997 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Openstack-System-Scope: None Jun 03 10:05:55.260997 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: User-Agent: python-urllib3/1.26.9 Jun 03 10:05:55.260997 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Auth-Token: gAAAAABimdyERpWAQe95aVogk3CBzbbvoVqsT1mcXcyeAA1KIeWqlrXYLL74Vx2g9GU9bQbymV8F-OiCfQLZd3XmBfURzXWp91tRpkL6WEAH_Q17Tl2wrUlWolA1gi8vDdxsnFf79KdskWgeoWa8fRazmnte5HviUSJ7Rm7SGX5FgU84B4GApr0 Jun 03 10:05:55.260997 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Id: None Jun 03 10:05:55.260997 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Name: None Jun 03 10:05:55.260997 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Identity-Status: Confirmed Jun 03 10:05:55.260997 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Is-Admin-Project: True Jun 03 10:05:55.260997 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Id: default Jun 03 10:05:55.260997 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Name: Default Jun 03 10:05:55.260997 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Id: 3e51010dd5d84daf8aa43859e9e7cb6d Jun 03 10:05:55.260997 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Name: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:05:55.260997 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Role: member,reader Jun 03 10:05:55.260997 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Roles: member,reader Jun 03 10:05:55.263275 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3e51010dd5d84daf8aa43859e9e7cb6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e51010dd5d84daf8aa43859e9e7cb6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3e51010dd5d84daf8aa43859e9e7cb6d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e51010dd5d84daf8aa43859e9e7cb6d"}]}] Jun 03 10:05:55.263275 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:05:55.263275 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Id: 3e51010dd5d84daf8aa43859e9e7cb6d Jun 03 10:05:55.263275 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:05:55.263275 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User: tempest-AttachVolumeNegativeTest-1165735283-project Jun 03 10:05:55.263275 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Id: default Jun 03 10:05:55.263275 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Name: Default Jun 03 10:05:55.263275 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Id: ce77221a2c8d4c4395bed092c1967b28 Jun 03 10:05:55.263275 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Name: tempest-AttachVolumeNegativeTest-1165735283-project Jun 03 10:05:55.263275 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Jun 03 10:05:55.263275 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: {"volumeAttachment": {"volumeId": "36329aa3-1fe5-4c8d-a62c-8b8c0d1e260b"}} Jun 03 10:05:55.263275 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: method: > Jun 03 10:05:55.264273 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: exception: Invalid volume: volume 36329aa3-1fe5-4c8d-a62c-8b8c0d1e260b is already attached to instances: 17b2f507-9340-486f-92ed-d249b5b78d78 Jun 03 10:05:55.264273 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: action_args: {'server_id': 'aa10760a-d45e-497a-8f67-9cd6ed2eb585', 'body': {'volumeAttachment': {'volumeId': '36329aa3-1fe5-4c8d-a62c-8b8c0d1e260b'}}} Jun 03 10:05:55.264273 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:05:55.264273 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:55.264273 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 03 10:05:55.264273 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 03 10:05:55.264273 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 03 10:05:55.264273 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 03 10:05:55.264273 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 03 10:05:55.264273 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 03 10:05:55.264273 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 03 10:05:55.264273 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 03 10:05:55.264273 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 03 10:05:55.264273 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 03 10:05:55.264273 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 36329aa3-1fe5-4c8d-a62c-8b8c0d1e260b is already attached to instances: 17b2f507-9340-486f-92ed-d249b5b78d78 Jun 03 10:05:55.264273 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:05:55.264273 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:05:55.264273 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:05:55.264273 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:55.265819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:05:55.265819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:05:55.265819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:05:55.265819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:05:55.265819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:05:55.265819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:05:55.265819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 10:05:55.265819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 10:05:55.265819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 10:05:55.265819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 10:05:55.265819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 10:05:55.265819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 10:05:55.265819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 03 10:05:55.265819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 03 10:05:55.265819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 36329aa3-1fe5-4c8d-a62c-8b8c0d1e260b is already attached to instances: 17b2f507-9340-486f-92ed-d249b5b78d78 Jun 03 10:05:55.265819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:05:55.265819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:05:55.265819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:05:55.265819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:55.265819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:05:55.267511 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:05:55.267511 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:05:55.267511 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:05:55.267511 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 36329aa3-1fe5-4c8d-a62c-8b8c0d1e260b is already attached to instances: 17b2f507-9340-486f-92ed-d249b5b78d78 Jun 03 10:05:55.267511 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:05:55.267511 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-9b6d27b2-6b34-4879-8e3d-5e7fb8ab0627 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Returning 400 to user: Invalid volume: volume 36329aa3-1fe5-4c8d-a62c-8b8c0d1e260b is already attached to instances: 17b2f507-9340-486f-92ed-d249b5b78d78 {{(pid=125065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:05:55.267511 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-9b6d27b2-6b34-4879-8e3d-5e7fb8ab0627 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "POST /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100250 Jun 03 10:05:55.267511 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 463/910] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jun 3 10:05:55 2022] POST /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 03 10:05:55.272054 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-bd344909-c10d-4fd6-bfa4-4e7f229b1889 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:55.272547 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-bd344909-c10d-4fd6-bfa4-4e7f229b1889 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: aa10760a-d45e-497a-8f67-9cd6ed2eb585] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:55.279502 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bd344909-c10d-4fd6-bfa4-4e7f229b1889 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:55.279955 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bd344909-c10d-4fd6-bfa4-4e7f229b1889 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:55.282622 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bd344909-c10d-4fd6-bfa4-4e7f229b1889 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:55.282622 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bd344909-c10d-4fd6-bfa4-4e7f229b1889 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:55.305775 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-bd344909-c10d-4fd6-bfa4-4e7f229b1889 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: aa10760a-d45e-497a-8f67-9cd6ed2eb585] Going to try to terminate instance {{(pid=125066) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:05:55.585850 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-bd344909-c10d-4fd6-bfa4-4e7f229b1889 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "DELETE /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585" status: 204 len: 0 microversion: 2.1 time: 0.317627 Jun 03 10:05:55.586466 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 448/911] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 3 10:05:55 2022] DELETE /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:05:55.595537 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-f1f02fa8-3bfd-4896-9e45-14b62ea45012 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:55.596149 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-f1f02fa8-3bfd-4896-9e45-14b62ea45012 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: aa10760a-d45e-497a-8f67-9cd6ed2eb585] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:55.603067 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f1f02fa8-3bfd-4896-9e45-14b62ea45012 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:55.603514 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f1f02fa8-3bfd-4896-9e45-14b62ea45012 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:55.604278 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f1f02fa8-3bfd-4896-9e45-14b62ea45012 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:55.604717 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f1f02fa8-3bfd-4896-9e45-14b62ea45012 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:55.885609 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f1f02fa8-3bfd-4896-9e45-14b62ea45012 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:55.885609 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-f1f02fa8-3bfd-4896-9e45-14b62ea45012 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585" status: 200 len: 1681 microversion: 2.1 time: 0.161172 Jun 03 10:05:55.885609 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 464/912] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:55 2022] GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:56.771040 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-2f3866de-1f26-4ce0-818e-1484a1557d24 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:56.771759 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-2f3866de-1f26-4ce0-818e-1484a1557d24 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: aa10760a-d45e-497a-8f67-9cd6ed2eb585] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:56.778810 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2f3866de-1f26-4ce0-818e-1484a1557d24 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:56.779254 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2f3866de-1f26-4ce0-818e-1484a1557d24 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:56.780005 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2f3866de-1f26-4ce0-818e-1484a1557d24 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:56.780438 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2f3866de-1f26-4ce0-818e-1484a1557d24 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:56.914416 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-2f3866de-1f26-4ce0-818e-1484a1557d24 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:56.922936 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-2f3866de-1f26-4ce0-818e-1484a1557d24 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585" status: 200 len: 1681 microversion: 2.1 time: 0.156139 Jun 03 10:05:56.923515 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 449/913] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:56 2022] GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:57.940187 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-8b9c94c5-2034-42c2-9b16-cbffba309a3f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:57.940796 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-8b9c94c5-2034-42c2-9b16-cbffba309a3f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: aa10760a-d45e-497a-8f67-9cd6ed2eb585] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:57.948096 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8b9c94c5-2034-42c2-9b16-cbffba309a3f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:57.948549 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8b9c94c5-2034-42c2-9b16-cbffba309a3f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:57.949642 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8b9c94c5-2034-42c2-9b16-cbffba309a3f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:57.950110 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8b9c94c5-2034-42c2-9b16-cbffba309a3f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:58.077227 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-8b9c94c5-2034-42c2-9b16-cbffba309a3f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:58.084802 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-8b9c94c5-2034-42c2-9b16-cbffba309a3f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585" status: 200 len: 1681 microversion: 2.1 time: 0.148582 Jun 03 10:05:58.085364 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 465/914] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:57 2022] GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:59.102428 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-e0fe548f-1650-4a89-9500-0e13084ce90e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:59.103144 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-e0fe548f-1650-4a89-9500-0e13084ce90e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: aa10760a-d45e-497a-8f67-9cd6ed2eb585] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:59.109688 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e0fe548f-1650-4a89-9500-0e13084ce90e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:59.110253 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e0fe548f-1650-4a89-9500-0e13084ce90e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:59.111108 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e0fe548f-1650-4a89-9500-0e13084ce90e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:59.111633 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e0fe548f-1650-4a89-9500-0e13084ce90e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:59.315472 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-e0fe548f-1650-4a89-9500-0e13084ce90e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:59.323079 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-e0fe548f-1650-4a89-9500-0e13084ce90e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585" status: 200 len: 1681 microversion: 2.1 time: 0.224540 Jun 03 10:05:59.323774 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 450/915] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:59 2022] GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585 => generated 1681 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:59.965384 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-83b0abe4-ca4b-4816-aa46-b88a05505302 req-14dd43ad-14c8-40ee-a2ca-5a27b0ebbbb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa10760a-d45e-497a-8f67-9cd6ed2eb585", "name": "network-vif-deleted", "tag": "69dac938-25d4-4980-b714-07010ccce88d"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:05:59.974159 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-83b0abe4-ca4b-4816-aa46-b88a05505302 req-14dd43ad-14c8-40ee-a2ca-5a27b0ebbbb0 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:59.974606 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-83b0abe4-ca4b-4816-aa46-b88a05505302 req-14dd43ad-14c8-40ee-a2ca-5a27b0ebbbb0 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:59.987296 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-83b0abe4-ca4b-4816-aa46-b88a05505302 req-14dd43ad-14c8-40ee-a2ca-5a27b0ebbbb0 service nova] Creating event network-vif-deleted:69dac938-25d4-4980-b714-07010ccce88d for instance aa10760a-d45e-497a-8f67-9cd6ed2eb585 on hv-cinder-84456 Jun 03 10:05:59.992528 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-83b0abe4-ca4b-4816-aa46-b88a05505302 req-14dd43ad-14c8-40ee-a2ca-5a27b0ebbbb0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031293 Jun 03 10:05:59.993311 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 466/916] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:06:00.341399 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-45988df0-0087-42c1-afd3-e3a8b2933290 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:00.342132 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-45988df0-0087-42c1-afd3-e3a8b2933290 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: aa10760a-d45e-497a-8f67-9cd6ed2eb585] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:00.349425 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-45988df0-0087-42c1-afd3-e3a8b2933290 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:00.349858 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-45988df0-0087-42c1-afd3-e3a8b2933290 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:00.350900 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-45988df0-0087-42c1-afd3-e3a8b2933290 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:00.351433 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-45988df0-0087-42c1-afd3-e3a8b2933290 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:00.389349 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-45988df0-0087-42c1-afd3-e3a8b2933290 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:00.389823 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-45988df0-0087-42c1-afd3-e3a8b2933290 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:00.390309 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.objects.instance [None req-45988df0-0087-42c1-afd3-e3a8b2933290 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lazy-loading 'fault' on Instance uuid aa10760a-d45e-497a-8f67-9cd6ed2eb585 {{(pid=125066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:06:00.432411 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-45988df0-0087-42c1-afd3-e3a8b2933290 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:00.440487 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-45988df0-0087-42c1-afd3-e3a8b2933290 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585" status: 200 len: 1332 microversion: 2.1 time: 0.103952 Jun 03 10:06:00.441064 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 451/917] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:00 2022] GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585 => generated 1332 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:01.459689 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-47498e1b-10d8-4dd0-8548-fceb7542b400 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:01.460478 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-47498e1b-10d8-4dd0-8548-fceb7542b400 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: aa10760a-d45e-497a-8f67-9cd6ed2eb585] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:01.467570 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-47498e1b-10d8-4dd0-8548-fceb7542b400 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:01.468027 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-47498e1b-10d8-4dd0-8548-fceb7542b400 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:01.468800 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-47498e1b-10d8-4dd0-8548-fceb7542b400 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:01.469238 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-47498e1b-10d8-4dd0-8548-fceb7542b400 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:01.483780 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.wsgi [None req-47498e1b-10d8-4dd0-8548-fceb7542b400 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] HTTP exception thrown: Instance aa10760a-d45e-497a-8f67-9cd6ed2eb585 could not be found. Jun 03 10:06:01.486555 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-47498e1b-10d8-4dd0-8548-fceb7542b400 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Request method failure captured: Jun 03 10:06:01.486555 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: request: GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585 HTTP/1.1 Jun 03 10:06:01.486555 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept: application/json Jun 03 10:06:01.486555 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept-Encoding: identity Jun 03 10:06:01.486555 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Connection: close Jun 03 10:06:01.486555 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Length: 0 Jun 03 10:06:01.486555 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Type: application/json Jun 03 10:06:01.486555 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Host: 10.222.0.42 Jun 03 10:06:01.486555 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Openstack-System-Scope: None Jun 03 10:06:01.486555 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: User-Agent: python-urllib3/1.26.9 Jun 03 10:06:01.486555 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Auth-Token: gAAAAABimdyERpWAQe95aVogk3CBzbbvoVqsT1mcXcyeAA1KIeWqlrXYLL74Vx2g9GU9bQbymV8F-OiCfQLZd3XmBfURzXWp91tRpkL6WEAH_Q17Tl2wrUlWolA1gi8vDdxsnFf79KdskWgeoWa8fRazmnte5HviUSJ7Rm7SGX5FgU84B4GApr0 Jun 03 10:06:01.486555 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Id: None Jun 03 10:06:01.486555 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Name: None Jun 03 10:06:01.486555 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Identity-Status: Confirmed Jun 03 10:06:01.486555 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Is-Admin-Project: True Jun 03 10:06:01.486555 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Id: default Jun 03 10:06:01.486555 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Name: Default Jun 03 10:06:01.486555 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Id: 3e51010dd5d84daf8aa43859e9e7cb6d Jun 03 10:06:01.486555 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Name: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:06:01.486555 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Role: member,reader Jun 03 10:06:01.486555 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Roles: member,reader Jun 03 10:06:01.488270 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3e51010dd5d84daf8aa43859e9e7cb6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e51010dd5d84daf8aa43859e9e7cb6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3e51010dd5d84daf8aa43859e9e7cb6d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e51010dd5d84daf8aa43859e9e7cb6d"}]}] Jun 03 10:06:01.488270 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:06:01.488270 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Id: 3e51010dd5d84daf8aa43859e9e7cb6d Jun 03 10:06:01.488270 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:06:01.488270 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User: tempest-AttachVolumeNegativeTest-1165735283-project Jun 03 10:06:01.488270 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Id: default Jun 03 10:06:01.488270 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Name: Default Jun 03 10:06:01.488270 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Id: ce77221a2c8d4c4395bed092c1967b28 Jun 03 10:06:01.488270 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Name: tempest-AttachVolumeNegativeTest-1165735283-project Jun 03 10:06:01.488270 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: method: > Jun 03 10:06:01.488270 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: exception: Instance aa10760a-d45e-497a-8f67-9cd6ed2eb585 could not be found. Jun 03 10:06:01.488270 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: action_args: {'id': 'aa10760a-d45e-497a-8f67-9cd6ed2eb585'} Jun 03 10:06:01.489057 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:06:01.489057 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:06:01.489057 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:06:01.489057 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:06:01.489057 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:06:01.489057 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:06:01.489057 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:06:01.489057 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:06:01.489057 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:06:01.489057 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:06:01.489057 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa10760a-d45e-497a-8f67-9cd6ed2eb585 could not be found. Jun 03 10:06:01.489057 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:06:01.489057 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:06:01.489057 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:06:01.489057 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:06:01.489057 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:06:01.489057 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:06:01.489057 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:06:01.489057 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:06:01.489057 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:06:01.490917 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:06:01.490917 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:06:01.490917 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:06:01.490917 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:06:01.490917 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:06:01.490917 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:06:01.490917 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:06:01.490917 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa10760a-d45e-497a-8f67-9cd6ed2eb585 could not be found. Jun 03 10:06:01.490917 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:06:01.490917 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:06:01.490917 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:06:01.490917 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:06:01.490917 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:06:01.490917 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:06:01.490917 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:06:01.490917 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:06:01.490917 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa10760a-d45e-497a-8f67-9cd6ed2eb585 could not be found. Jun 03 10:06:01.490917 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:06:01.492145 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-47498e1b-10d8-4dd0-8548-fceb7542b400 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Returning 404 to user: Instance aa10760a-d45e-497a-8f67-9cd6ed2eb585 could not be found. {{(pid=125065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:06:01.492145 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-47498e1b-10d8-4dd0-8548-fceb7542b400 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585" status: 404 len: 111 microversion: 2.1 time: 0.032007 Jun 03 10:06:01.492145 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 467/918] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:01 2022] GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 10:06:01.496396 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-0ec1f227-1f27-4571-9cca-10e722084591 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '.version_select at 0x7f8d23ecfd30>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:01.564061 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-0ec1f227-1f27-4571-9cca-10e722084591 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1253900515" status: 202 len: 0 microversion: 2.1 time: 0.071957 Jun 03 10:06:01.564657 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 452/919] 10.222.0.42 () {58 vars in 1220 bytes} [Fri Jun 3 10:06:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1253900515 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:06:02.384404 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-41e9529e-5fb0-48f9-ba15-ffec05a055fa tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:02.384897 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-41e9529e-5fb0-48f9-ba15-ffec05a055fa tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 17b2f507-9340-486f-92ed-d249b5b78d78] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:02.391239 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-41e9529e-5fb0-48f9-ba15-ffec05a055fa tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:02.391691 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-41e9529e-5fb0-48f9-ba15-ffec05a055fa tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:02.392455 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-41e9529e-5fb0-48f9-ba15-ffec05a055fa tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:02.392892 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-41e9529e-5fb0-48f9-ba15-ffec05a055fa tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:02.477288 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.objects.instance [None req-41e9529e-5fb0-48f9-ba15-ffec05a055fa tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lazy-loading 'services' on Instance uuid 17b2f507-9340-486f-92ed-d249b5b78d78 {{(pid=125065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:06:02.773947 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-41e9529e-5fb0-48f9-ba15-ffec05a055fa tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "DELETE /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78/os-volume_attachments/36329aa3-1fe5-4c8d-a62c-8b8c0d1e260b" status: 202 len: 0 microversion: 2.1 time: 0.393360 Jun 03 10:06:02.774508 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 468/920] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jun 3 10:06:02 2022] DELETE /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78/os-volume_attachments/36329aa3-1fe5-4c8d-a62c-8b8c0d1e260b => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:06:02.784098 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-130239d7-24ca-48f6-a570-4282a37f9c5d tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:02.785040 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-130239d7-24ca-48f6-a570-4282a37f9c5d tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 17b2f507-9340-486f-92ed-d249b5b78d78] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:02.791709 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-130239d7-24ca-48f6-a570-4282a37f9c5d tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:02.792157 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-130239d7-24ca-48f6-a570-4282a37f9c5d tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:02.793607 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-130239d7-24ca-48f6-a570-4282a37f9c5d tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:02.794095 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-130239d7-24ca-48f6-a570-4282a37f9c5d tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:02.822287 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-130239d7-24ca-48f6-a570-4282a37f9c5d tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042692 Jun 03 10:06:02.822852 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 453/921] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 3 10:06:02 2022] GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:06:03.834199 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-97eab5e3-adac-4c34-bdcd-1c3f41c874ea tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:03.835258 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-97eab5e3-adac-4c34-bdcd-1c3f41c874ea tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 17b2f507-9340-486f-92ed-d249b5b78d78] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:03.842071 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-97eab5e3-adac-4c34-bdcd-1c3f41c874ea tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:03.842519 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-97eab5e3-adac-4c34-bdcd-1c3f41c874ea tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:03.843284 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-97eab5e3-adac-4c34-bdcd-1c3f41c874ea tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:03.843715 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-97eab5e3-adac-4c34-bdcd-1c3f41c874ea tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:03.873246 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-97eab5e3-adac-4c34-bdcd-1c3f41c874ea tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043446 Jun 03 10:06:03.873739 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 469/922] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 3 10:06:03 2022] GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 10:06:03.946505 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-2b012900-106f-4207-9899-3ca88cf681e0 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:03.947132 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-2b012900-106f-4207-9899-3ca88cf681e0 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 17b2f507-9340-486f-92ed-d249b5b78d78] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:03.954250 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2b012900-106f-4207-9899-3ca88cf681e0 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:03.955052 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2b012900-106f-4207-9899-3ca88cf681e0 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:03.956067 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2b012900-106f-4207-9899-3ca88cf681e0 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:03.956505 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2b012900-106f-4207-9899-3ca88cf681e0 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:03.984522 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-2b012900-106f-4207-9899-3ca88cf681e0 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 17b2f507-9340-486f-92ed-d249b5b78d78] Going to try to terminate instance {{(pid=125066) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:06:04.237045 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-2b012900-106f-4207-9899-3ca88cf681e0 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "DELETE /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78" status: 204 len: 0 microversion: 2.1 time: 0.294551 Jun 03 10:06:04.237659 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 454/923] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 3 10:06:03 2022] DELETE /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:06:04.245931 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-451f6535-54a2-4818-b857-5915a5e909ac tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:04.246541 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-451f6535-54a2-4818-b857-5915a5e909ac tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 17b2f507-9340-486f-92ed-d249b5b78d78] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:04.252591 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-451f6535-54a2-4818-b857-5915a5e909ac tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:04.253041 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-451f6535-54a2-4818-b857-5915a5e909ac tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:04.253805 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-451f6535-54a2-4818-b857-5915a5e909ac tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:04.254267 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-451f6535-54a2-4818-b857-5915a5e909ac tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:04.380836 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-451f6535-54a2-4818-b857-5915a5e909ac tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:04.388712 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-451f6535-54a2-4818-b857-5915a5e909ac tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78" status: 200 len: 1680 microversion: 2.1 time: 0.146638 Jun 03 10:06:04.389328 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 470/924] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:04 2022] GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78 => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:05.408401 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-22ed1e7b-483e-4ab7-b68c-5d5917496c5b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:05.408401 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-22ed1e7b-483e-4ab7-b68c-5d5917496c5b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 17b2f507-9340-486f-92ed-d249b5b78d78] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:05.413727 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-22ed1e7b-483e-4ab7-b68c-5d5917496c5b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:05.414234 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-22ed1e7b-483e-4ab7-b68c-5d5917496c5b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:05.415233 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-22ed1e7b-483e-4ab7-b68c-5d5917496c5b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:05.415671 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-22ed1e7b-483e-4ab7-b68c-5d5917496c5b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:05.549266 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-22ed1e7b-483e-4ab7-b68c-5d5917496c5b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:05.556964 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-22ed1e7b-483e-4ab7-b68c-5d5917496c5b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78" status: 200 len: 1680 microversion: 2.1 time: 0.154821 Jun 03 10:06:05.557535 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 455/925] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:05 2022] GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:06.579581 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-3b1c7bfe-a947-447c-b092-ce4dd5d0e35c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:06.588809 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-3b1c7bfe-a947-447c-b092-ce4dd5d0e35c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 17b2f507-9340-486f-92ed-d249b5b78d78] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:06.588809 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3b1c7bfe-a947-447c-b092-ce4dd5d0e35c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:06.588809 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3b1c7bfe-a947-447c-b092-ce4dd5d0e35c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:06.589116 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3b1c7bfe-a947-447c-b092-ce4dd5d0e35c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:06.589540 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3b1c7bfe-a947-447c-b092-ce4dd5d0e35c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:06.765627 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-3b1c7bfe-a947-447c-b092-ce4dd5d0e35c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:06.775006 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-3b1c7bfe-a947-447c-b092-ce4dd5d0e35c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78" status: 200 len: 1680 microversion: 2.1 time: 0.199250 Jun 03 10:06:06.775685 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 471/926] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:06 2022] GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78 => generated 1680 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:07.043771 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-d94800a0-148f-423a-a855-4241892509b4 req-bdd1a30f-7c4e-4a47-9d7f-98463bf5a882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17b2f507-9340-486f-92ed-d249b5b78d78", "name": "network-vif-deleted", "tag": "8b1d6a25-ec19-48dd-8b87-919d443e61a6"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:06:07.060264 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-d94800a0-148f-423a-a855-4241892509b4 req-bdd1a30f-7c4e-4a47-9d7f-98463bf5a882 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:07.060742 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-d94800a0-148f-423a-a855-4241892509b4 req-bdd1a30f-7c4e-4a47-9d7f-98463bf5a882 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:07.087903 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-d94800a0-148f-423a-a855-4241892509b4 req-bdd1a30f-7c4e-4a47-9d7f-98463bf5a882 service nova] Creating event network-vif-deleted:8b1d6a25-ec19-48dd-8b87-919d443e61a6 for instance 17b2f507-9340-486f-92ed-d249b5b78d78 on hv-cinder-84456 Jun 03 10:06:07.095927 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-d94800a0-148f-423a-a855-4241892509b4 req-bdd1a30f-7c4e-4a47-9d7f-98463bf5a882 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059996 Jun 03 10:06:07.096589 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 456/927] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:06:07.794048 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-f8bc5027-b518-4f16-be1a-10633af3c868 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:07.794767 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-f8bc5027-b518-4f16-be1a-10633af3c868 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 17b2f507-9340-486f-92ed-d249b5b78d78] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:07.800941 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f8bc5027-b518-4f16-be1a-10633af3c868 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:07.802369 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f8bc5027-b518-4f16-be1a-10633af3c868 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:07.802369 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f8bc5027-b518-4f16-be1a-10633af3c868 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:07.802605 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f8bc5027-b518-4f16-be1a-10633af3c868 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:07.838932 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f8bc5027-b518-4f16-be1a-10633af3c868 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:07.839519 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f8bc5027-b518-4f16-be1a-10633af3c868 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:07.840088 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.objects.instance [None req-f8bc5027-b518-4f16-be1a-10633af3c868 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lazy-loading 'fault' on Instance uuid 17b2f507-9340-486f-92ed-d249b5b78d78 {{(pid=125065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:06:07.890213 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f8bc5027-b518-4f16-be1a-10633af3c868 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:07.898761 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-f8bc5027-b518-4f16-be1a-10633af3c868 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78" status: 200 len: 1330 microversion: 2.1 time: 0.108479 Jun 03 10:06:07.899346 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 472/928] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:07 2022] GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78 => generated 1330 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:08.916672 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-0d5749f0-2fa6-4f0a-a813-f5a839c6c75a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:08.917358 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-0d5749f0-2fa6-4f0a-a813-f5a839c6c75a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 17b2f507-9340-486f-92ed-d249b5b78d78] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:08.927324 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0d5749f0-2fa6-4f0a-a813-f5a839c6c75a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:08.927324 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0d5749f0-2fa6-4f0a-a813-f5a839c6c75a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:08.927324 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0d5749f0-2fa6-4f0a-a813-f5a839c6c75a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:08.927324 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0d5749f0-2fa6-4f0a-a813-f5a839c6c75a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:08.940000 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.wsgi [None req-0d5749f0-2fa6-4f0a-a813-f5a839c6c75a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] HTTP exception thrown: Instance 17b2f507-9340-486f-92ed-d249b5b78d78 could not be found. Jun 03 10:06:08.941680 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-0d5749f0-2fa6-4f0a-a813-f5a839c6c75a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Request method failure captured: Jun 03 10:06:08.941680 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: request: GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78 HTTP/1.1 Jun 03 10:06:08.941680 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept: application/json Jun 03 10:06:08.941680 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept-Encoding: identity Jun 03 10:06:08.941680 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Connection: close Jun 03 10:06:08.941680 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Length: 0 Jun 03 10:06:08.941680 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Type: application/json Jun 03 10:06:08.941680 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Host: 10.222.0.42 Jun 03 10:06:08.941680 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Openstack-System-Scope: None Jun 03 10:06:08.941680 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: User-Agent: python-urllib3/1.26.9 Jun 03 10:06:08.941680 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Auth-Token: gAAAAABimdyERpWAQe95aVogk3CBzbbvoVqsT1mcXcyeAA1KIeWqlrXYLL74Vx2g9GU9bQbymV8F-OiCfQLZd3XmBfURzXWp91tRpkL6WEAH_Q17Tl2wrUlWolA1gi8vDdxsnFf79KdskWgeoWa8fRazmnte5HviUSJ7Rm7SGX5FgU84B4GApr0 Jun 03 10:06:08.941680 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Id: None Jun 03 10:06:08.941680 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Name: None Jun 03 10:06:08.941680 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Identity-Status: Confirmed Jun 03 10:06:08.941680 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Is-Admin-Project: True Jun 03 10:06:08.941680 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Id: default Jun 03 10:06:08.941680 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Name: Default Jun 03 10:06:08.941680 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Id: 3e51010dd5d84daf8aa43859e9e7cb6d Jun 03 10:06:08.941680 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Name: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:06:08.941680 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Role: member,reader Jun 03 10:06:08.941680 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Roles: member,reader Jun 03 10:06:08.943365 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3e51010dd5d84daf8aa43859e9e7cb6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e51010dd5d84daf8aa43859e9e7cb6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3e51010dd5d84daf8aa43859e9e7cb6d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e51010dd5d84daf8aa43859e9e7cb6d"}]}] Jun 03 10:06:08.943365 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:06:08.943365 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Id: 3e51010dd5d84daf8aa43859e9e7cb6d Jun 03 10:06:08.943365 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:06:08.943365 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User: tempest-AttachVolumeNegativeTest-1165735283-project Jun 03 10:06:08.943365 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Id: default Jun 03 10:06:08.943365 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Name: Default Jun 03 10:06:08.943365 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Id: ce77221a2c8d4c4395bed092c1967b28 Jun 03 10:06:08.943365 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Name: tempest-AttachVolumeNegativeTest-1165735283-project Jun 03 10:06:08.943365 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: method: > Jun 03 10:06:08.943365 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: exception: Instance 17b2f507-9340-486f-92ed-d249b5b78d78 could not be found. Jun 03 10:06:08.943365 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: action_args: {'id': '17b2f507-9340-486f-92ed-d249b5b78d78'} Jun 03 10:06:08.944188 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:06:08.944188 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:06:08.944188 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:06:08.944188 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:06:08.944188 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:06:08.944188 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:06:08.944188 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:06:08.944188 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:06:08.944188 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:06:08.944188 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:06:08.944188 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17b2f507-9340-486f-92ed-d249b5b78d78 could not be found. Jun 03 10:06:08.944188 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:06:08.944188 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:06:08.944188 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:06:08.944188 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:06:08.944188 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:06:08.944188 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:06:08.944188 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:06:08.944188 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:06:08.944188 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:06:08.945610 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:06:08.945610 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:06:08.945610 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:06:08.945610 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:06:08.945610 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:06:08.945610 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:06:08.945610 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:06:08.945610 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17b2f507-9340-486f-92ed-d249b5b78d78 could not be found. Jun 03 10:06:08.945610 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:06:08.945610 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:06:08.945610 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:06:08.945610 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:06:08.945610 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:06:08.945610 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:06:08.945610 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:06:08.945610 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:06:08.945610 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17b2f507-9340-486f-92ed-d249b5b78d78 could not be found. Jun 03 10:06:08.945610 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:06:08.946948 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-0d5749f0-2fa6-4f0a-a813-f5a839c6c75a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Returning 404 to user: Instance 17b2f507-9340-486f-92ed-d249b5b78d78 could not be found. {{(pid=125066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:06:08.946948 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-0d5749f0-2fa6-4f0a-a813-f5a839c6c75a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78" status: 404 len: 111 microversion: 2.1 time: 0.030687 Jun 03 10:06:08.946948 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 457/929] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:08 2022] GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:06:08.952735 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-6fcf049a-bf58-489c-ab57-73dd9a8418b7 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '.version_select at 0x7f8d3516c0d0>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:09.101219 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-6fcf049a-bf58-489c-ab57-73dd9a8418b7 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-479088882" status: 202 len: 0 microversion: 2.1 time: 0.152791 Jun 03 10:06:09.107084 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 473/930] 10.222.0.42 () {58 vars in 1217 bytes} [Fri Jun 3 10:06:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-479088882 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:06:10.160418 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-5af7ff1a-9b24-48d9-b110-906658f48f0c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Action: 'create', calling method: .version_select at 0x7f8d23e56af0>, body: {"keypair": {"name": "tempest-keypair-1367712060", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBIALfWT6VuNOE0yEZJsVUMoy+zCK0nq5TyDJ/rPjmvBw1NHSBQSIk1jtLmwJE7bnAeceOOHzDA4CK6F9i/+hv8c70IMBw6SdSN57txBH/HiO0SiMyQGoV9+Yb8btC6jw=="}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:06:10.175386 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-5af7ff1a-9b24-48d9-b110-906658f48f0c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Getting quotas for project 3e51010dd5d84daf8aa43859e9e7cb6d. Resources: {'key_pairs'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:06:10.179456 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-5af7ff1a-9b24-48d9-b110-906658f48f0c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Getting quotas for user ce77221a2c8d4c4395bed092c1967b28 and project 3e51010dd5d84daf8aa43859e9e7cb6d. Resources: {'key_pairs'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:06:10.278102 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-5af7ff1a-9b24-48d9-b110-906658f48f0c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.121673 Jun 03 10:06:10.278626 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 458/931] 10.222.0.42 () {60 vars in 1158 bytes} [Fri Jun 3 10:06:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:06:12.816488 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-10b54f94-d577-4206-9ee7-a8a7b5b10fe2 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-576057840", "imageRef": "0d2dd03b-4531-46f3-88da-0380e97b1bd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "284be7b5-7c4f-4f54-b772-bb0f4e7cb533"}], "security_groups": [{"name": "tempest-securitygroup--943730602"}], "key_name": "tempest-keypair-1367712060", "user_data": "}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:06:12.922672 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.network.neutron [None req-10b54f94-d577-4206-9ee7-a8a7b5b10fe2 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] validate_networks() for [('284be7b5-7c4f-4f54-b772-bb0f4e7cb533', None, None, None, None, None)] {{(pid=125065) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 10:06:13.290861 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-10b54f94-d577-4206-9ee7-a8a7b5b10fe2 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Flavor limits 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 10:06:13.291312 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-10b54f94-d577-4206-9ee7-a8a7b5b10fe2 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Image limits 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 10:06:13.291810 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-10b54f94-d577-4206-9ee7-a8a7b5b10fe2 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Flavor pref 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 10:06:13.292213 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-10b54f94-d577-4206-9ee7-a8a7b5b10fe2 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Image pref 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 10:06:13.292643 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-10b54f94-d577-4206-9ee7-a8a7b5b10fe2 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 10:06:13.301280 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-10b54f94-d577-4206-9ee7-a8a7b5b10fe2 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:13.301718 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-10b54f94-d577-4206-9ee7-a8a7b5b10fe2 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:13.302545 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-10b54f94-d577-4206-9ee7-a8a7b5b10fe2 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:13.302975 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-10b54f94-d577-4206-9ee7-a8a7b5b10fe2 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:13.319136 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.quota [None req-10b54f94-d577-4206-9ee7-a8a7b5b10fe2 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Getting quotas for project 3e51010dd5d84daf8aa43859e9e7cb6d. Resources: {'ram', 'instances', 'cores'} {{(pid=125065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:06:13.322992 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.quota [None req-10b54f94-d577-4206-9ee7-a8a7b5b10fe2 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Getting quotas for user ce77221a2c8d4c4395bed092c1967b28 and project 3e51010dd5d84daf8aa43859e9e7cb6d. Resources: {'ram', 'instances', 'cores'} {{(pid=125065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:06:13.334166 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-10b54f94-d577-4206-9ee7-a8a7b5b10fe2 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Going to run 1 instances... {{(pid=125065) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 10:06:13.336378 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-10b54f94-d577-4206-9ee7-a8a7b5b10fe2 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2dd03b-4531-46f3-88da-0380e97b1bd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 10:06:13.443838 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-10b54f94-d577-4206-9ee7-a8a7b5b10fe2 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.631725 Jun 03 10:06:13.444470 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 474/932] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 3 10:06:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 10:06:13.455811 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-0f446fc8-4ea7-4239-8032-1b2e0790c966 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:13.456418 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-0f446fc8-4ea7-4239-8032-1b2e0790c966 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:13.519244 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-0f446fc8-4ea7-4239-8032-1b2e0790c966 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:13.526294 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-0f446fc8-4ea7-4239-8032-1b2e0790c966 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372" status: 200 len: 1241 microversion: 2.1 time: 0.075156 Jun 03 10:06:13.526933 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 459/933] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:13 2022] GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372 => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:14.544878 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-229b1244-be85-4b70-9fcd-d18b2c72cb9b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:14.545483 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-229b1244-be85-4b70-9fcd-d18b2c72cb9b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:14.552434 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-229b1244-be85-4b70-9fcd-d18b2c72cb9b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:14.552920 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-229b1244-be85-4b70-9fcd-d18b2c72cb9b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:14.553679 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-229b1244-be85-4b70-9fcd-d18b2c72cb9b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:14.554138 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-229b1244-be85-4b70-9fcd-d18b2c72cb9b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:14.614174 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-229b1244-be85-4b70-9fcd-d18b2c72cb9b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:14.621624 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-229b1244-be85-4b70-9fcd-d18b2c72cb9b tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372" status: 200 len: 1245 microversion: 2.1 time: 0.081837 Jun 03 10:06:14.622252 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 475/934] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:14 2022] GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:15.638525 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-44da544b-141e-4426-9119-1ebae5f463cf tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:15.639135 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-44da544b-141e-4426-9119-1ebae5f463cf tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:15.646115 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-44da544b-141e-4426-9119-1ebae5f463cf tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:15.646571 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-44da544b-141e-4426-9119-1ebae5f463cf tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:15.647334 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-44da544b-141e-4426-9119-1ebae5f463cf tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:15.647772 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-44da544b-141e-4426-9119-1ebae5f463cf tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:15.707678 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-44da544b-141e-4426-9119-1ebae5f463cf tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:15.715232 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-44da544b-141e-4426-9119-1ebae5f463cf tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372" status: 200 len: 1237 microversion: 2.1 time: 0.080685 Jun 03 10:06:15.715998 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 460/935] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:15 2022] GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372 => generated 1237 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:16.731843 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-2dcb813f-317a-40f7-8822-4a14eee21940 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:16.732462 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-2dcb813f-317a-40f7-8822-4a14eee21940 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:16.739403 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2dcb813f-317a-40f7-8822-4a14eee21940 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:16.739868 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2dcb813f-317a-40f7-8822-4a14eee21940 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:16.740740 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2dcb813f-317a-40f7-8822-4a14eee21940 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:16.741184 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2dcb813f-317a-40f7-8822-4a14eee21940 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:16.803271 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-2dcb813f-317a-40f7-8822-4a14eee21940 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:16.811408 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-2dcb813f-317a-40f7-8822-4a14eee21940 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372" status: 200 len: 1293 microversion: 2.1 time: 0.083448 Jun 03 10:06:16.811978 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 476/936] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:16 2022] GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372 => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:17.838106 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-93525bcf-dfed-4fdf-88bc-9e806c089a97 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:17.841539 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-93525bcf-dfed-4fdf-88bc-9e806c089a97 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:17.848990 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-93525bcf-dfed-4fdf-88bc-9e806c089a97 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:17.849442 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-93525bcf-dfed-4fdf-88bc-9e806c089a97 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:17.850247 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-93525bcf-dfed-4fdf-88bc-9e806c089a97 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:17.850868 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-93525bcf-dfed-4fdf-88bc-9e806c089a97 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:17.999678 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-93525bcf-dfed-4fdf-88bc-9e806c089a97 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:18.007922 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-93525bcf-dfed-4fdf-88bc-9e806c089a97 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372" status: 200 len: 1366 microversion: 2.1 time: 0.183482 Jun 03 10:06:18.008508 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 461/937] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:17 2022] GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:19.025096 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-eb36af46-ccd8-47d3-9177-e4627820b92f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:19.025637 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-eb36af46-ccd8-47d3-9177-e4627820b92f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:19.032841 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-eb36af46-ccd8-47d3-9177-e4627820b92f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:19.033295 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-eb36af46-ccd8-47d3-9177-e4627820b92f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:19.034117 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-eb36af46-ccd8-47d3-9177-e4627820b92f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:19.034577 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-eb36af46-ccd8-47d3-9177-e4627820b92f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:19.161912 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-eb36af46-ccd8-47d3-9177-e4627820b92f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:19.169937 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-eb36af46-ccd8-47d3-9177-e4627820b92f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372" status: 200 len: 1366 microversion: 2.1 time: 0.148773 Jun 03 10:06:19.170505 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 477/938] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:19 2022] GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:20.186685 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-43273a84-b446-4b0a-a572-c9bd13d67920 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:20.187290 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-43273a84-b446-4b0a-a572-c9bd13d67920 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:20.193729 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-43273a84-b446-4b0a-a572-c9bd13d67920 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:20.194206 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-43273a84-b446-4b0a-a572-c9bd13d67920 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:20.194959 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-43273a84-b446-4b0a-a572-c9bd13d67920 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:20.195387 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-43273a84-b446-4b0a-a572-c9bd13d67920 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:20.324365 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-43273a84-b446-4b0a-a572-c9bd13d67920 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:20.332269 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-43273a84-b446-4b0a-a572-c9bd13d67920 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372" status: 200 len: 1366 microversion: 2.1 time: 0.149513 Jun 03 10:06:20.332829 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 462/939] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:20 2022] GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:21.229295 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-e9df500d-ba6a-43ae-a9d7-bda9213b2951 req-7e14a28c-3128-48cf-9921-3cc98238e11f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21c2fa33-3843-4029-a7af-ae2571f5a372", "tag": "1622156a-d26f-40fe-89b8-7a97ced62e88"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:06:21.239583 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-e9df500d-ba6a-43ae-a9d7-bda9213b2951 req-7e14a28c-3128-48cf-9921-3cc98238e11f service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:21.241137 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-e9df500d-ba6a-43ae-a9d7-bda9213b2951 req-7e14a28c-3128-48cf-9921-3cc98238e11f service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:21.253751 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-e9df500d-ba6a-43ae-a9d7-bda9213b2951 req-7e14a28c-3128-48cf-9921-3cc98238e11f service nova] Creating event network-changed:1622156a-d26f-40fe-89b8-7a97ced62e88 for instance 21c2fa33-3843-4029-a7af-ae2571f5a372 on hv-cinder-84456 Jun 03 10:06:21.259514 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-e9df500d-ba6a-43ae-a9d7-bda9213b2951 req-7e14a28c-3128-48cf-9921-3cc98238e11f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034452 Jun 03 10:06:21.260755 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 478/940] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:06:21.349193 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-e8a38023-ad1a-45af-82b0-8efa7f4967f8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:21.349808 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-e8a38023-ad1a-45af-82b0-8efa7f4967f8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:21.357103 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e8a38023-ad1a-45af-82b0-8efa7f4967f8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:21.357717 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e8a38023-ad1a-45af-82b0-8efa7f4967f8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:21.359194 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e8a38023-ad1a-45af-82b0-8efa7f4967f8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:21.359687 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e8a38023-ad1a-45af-82b0-8efa7f4967f8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:21.574917 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-e8a38023-ad1a-45af-82b0-8efa7f4967f8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:21.582379 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-e8a38023-ad1a-45af-82b0-8efa7f4967f8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372" status: 200 len: 1366 microversion: 2.1 time: 0.237080 Jun 03 10:06:21.582941 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 463/941] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:21 2022] GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:22.599617 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-eec29e28-1dfe-4945-9e7c-1cfd412250c8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:22.600302 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-eec29e28-1dfe-4945-9e7c-1cfd412250c8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:22.607463 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-eec29e28-1dfe-4945-9e7c-1cfd412250c8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:22.607937 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-eec29e28-1dfe-4945-9e7c-1cfd412250c8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:22.608719 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-eec29e28-1dfe-4945-9e7c-1cfd412250c8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:22.609156 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-eec29e28-1dfe-4945-9e7c-1cfd412250c8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:22.785415 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-eec29e28-1dfe-4945-9e7c-1cfd412250c8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:22.792949 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-eec29e28-1dfe-4945-9e7c-1cfd412250c8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372" status: 200 len: 1366 microversion: 2.1 time: 0.197575 Jun 03 10:06:22.798022 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 479/942] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:22 2022] GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:23.815182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-4ab657d3-f3e8-490b-92a5-599adab1761c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:23.815182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-4ab657d3-f3e8-490b-92a5-599adab1761c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:23.815182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell0:SELECT=6 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:23.819332 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4ab657d3-f3e8-490b-92a5-599adab1761c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:23.819929 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4ab657d3-f3e8-490b-92a5-599adab1761c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:23.820961 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4ab657d3-f3e8-490b-92a5-599adab1761c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:23.821570 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4ab657d3-f3e8-490b-92a5-599adab1761c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:23.840309 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:23.979075 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-4ab657d3-f3e8-490b-92a5-599adab1761c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:23.986902 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-4ab657d3-f3e8-490b-92a5-599adab1761c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372" status: 200 len: 1366 microversion: 2.1 time: 0.180861 Jun 03 10:06:23.988073 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 464/943] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:23 2022] GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:25.004709 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-9b298403-ae26-45af-9231-dcd5d8fbe09e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:25.005480 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-9b298403-ae26-45af-9231-dcd5d8fbe09e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:25.007737 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell0:SELECT=2 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:25.008417 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell0:SELECT=6 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:25.013786 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9b298403-ae26-45af-9231-dcd5d8fbe09e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:25.014261 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9b298403-ae26-45af-9231-dcd5d8fbe09e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:25.015062 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9b298403-ae26-45af-9231-dcd5d8fbe09e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:25.015502 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9b298403-ae26-45af-9231-dcd5d8fbe09e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:25.154029 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-9b298403-ae26-45af-9231-dcd5d8fbe09e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:25.159538 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-9b298403-ae26-45af-9231-dcd5d8fbe09e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372" status: 200 len: 1366 microversion: 2.1 time: 0.158698 Jun 03 10:06:25.160121 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 480/944] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:24 2022] GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:25.946857 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-de1b8721-b928-4352-b6d7-203e5ea34ccf req-fa7ac932-a1e0-478d-8c08-4ae284595ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21c2fa33-3843-4029-a7af-ae2571f5a372", "name": "network-vif-plugged", "status": "completed", "tag": "1622156a-d26f-40fe-89b8-7a97ced62e88"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:06:25.952059 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:25.956576 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-de1b8721-b928-4352-b6d7-203e5ea34ccf req-fa7ac932-a1e0-478d-8c08-4ae284595ab6 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:25.957017 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-de1b8721-b928-4352-b6d7-203e5ea34ccf req-fa7ac932-a1e0-478d-8c08-4ae284595ab6 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:25.970425 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-de1b8721-b928-4352-b6d7-203e5ea34ccf req-fa7ac932-a1e0-478d-8c08-4ae284595ab6 service nova] Creating event network-vif-plugged:1622156a-d26f-40fe-89b8-7a97ced62e88 for instance 21c2fa33-3843-4029-a7af-ae2571f5a372 on hv-cinder-84456 Jun 03 10:06:25.975559 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-de1b8721-b928-4352-b6d7-203e5ea34ccf req-fa7ac932-a1e0-478d-8c08-4ae284595ab6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032298 Jun 03 10:06:25.976138 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 465/945] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:06:26.177135 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-6a07cc35-14c1-43cb-b0a7-6144f4e03ea8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:26.178418 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-6a07cc35-14c1-43cb-b0a7-6144f4e03ea8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:26.183252 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:26.187998 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6a07cc35-14c1-43cb-b0a7-6144f4e03ea8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:26.188454 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6a07cc35-14c1-43cb-b0a7-6144f4e03ea8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:26.189242 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6a07cc35-14c1-43cb-b0a7-6144f4e03ea8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:26.189682 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6a07cc35-14c1-43cb-b0a7-6144f4e03ea8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:26.371968 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-6a07cc35-14c1-43cb-b0a7-6144f4e03ea8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:26.379791 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-6a07cc35-14c1-43cb-b0a7-6144f4e03ea8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372" status: 200 len: 1366 microversion: 2.1 time: 0.206619 Jun 03 10:06:26.380363 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 481/946] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:26 2022] GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:27.398661 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-9faa2938-d6ed-4e1d-a77f-91fdf173c10e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:27.399352 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-9faa2938-d6ed-4e1d-a77f-91fdf173c10e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:27.406794 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9faa2938-d6ed-4e1d-a77f-91fdf173c10e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:27.407118 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9faa2938-d6ed-4e1d-a77f-91fdf173c10e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:27.407875 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9faa2938-d6ed-4e1d-a77f-91fdf173c10e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:27.408312 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9faa2938-d6ed-4e1d-a77f-91fdf173c10e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:27.539494 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-9faa2938-d6ed-4e1d-a77f-91fdf173c10e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:27.546933 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-9faa2938-d6ed-4e1d-a77f-91fdf173c10e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372" status: 200 len: 1366 microversion: 2.1 time: 0.153578 Jun 03 10:06:27.547501 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 466/947] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:27 2022] GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:28.564693 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-7013aa42-455e-4dec-8083-c60a946e8d03 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:28.565295 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-7013aa42-455e-4dec-8083-c60a946e8d03 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:28.572266 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7013aa42-455e-4dec-8083-c60a946e8d03 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:28.572713 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7013aa42-455e-4dec-8083-c60a946e8d03 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:28.573472 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7013aa42-455e-4dec-8083-c60a946e8d03 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:28.573921 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7013aa42-455e-4dec-8083-c60a946e8d03 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:28.576470 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:28.703002 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-7013aa42-455e-4dec-8083-c60a946e8d03 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:28.710241 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-7013aa42-455e-4dec-8083-c60a946e8d03 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372" status: 200 len: 1366 microversion: 2.1 time: 0.150323 Jun 03 10:06:28.710814 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 482/948] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:28 2022] GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:29.727178 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-ccdc8e7c-a608-4ac8-b720-526b8dd56b9e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:29.727783 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-ccdc8e7c-a608-4ac8-b720-526b8dd56b9e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:29.734408 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ccdc8e7c-a608-4ac8-b720-526b8dd56b9e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:29.734850 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ccdc8e7c-a608-4ac8-b720-526b8dd56b9e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:29.735601 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ccdc8e7c-a608-4ac8-b720-526b8dd56b9e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:29.736036 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ccdc8e7c-a608-4ac8-b720-526b8dd56b9e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:29.866139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-ccdc8e7c-a608-4ac8-b720-526b8dd56b9e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:29.873895 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-ccdc8e7c-a608-4ac8-b720-526b8dd56b9e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372" status: 200 len: 1366 microversion: 2.1 time: 0.150916 Jun 03 10:06:29.874544 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 467/949] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:29 2022] GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:30.891947 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-9f7e088d-e9e5-4ae9-8e72-7229d5a54717 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:30.892538 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-9f7e088d-e9e5-4ae9-8e72-7229d5a54717 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:30.899704 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9f7e088d-e9e5-4ae9-8e72-7229d5a54717 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:30.900160 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9f7e088d-e9e5-4ae9-8e72-7229d5a54717 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:30.900931 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9f7e088d-e9e5-4ae9-8e72-7229d5a54717 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:30.901368 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9f7e088d-e9e5-4ae9-8e72-7229d5a54717 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:31.042446 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-9f7e088d-e9e5-4ae9-8e72-7229d5a54717 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:31.050511 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-9f7e088d-e9e5-4ae9-8e72-7229d5a54717 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372" status: 200 len: 1556 microversion: 2.1 time: 0.162577 Jun 03 10:06:31.051258 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 483/950] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:30 2022] GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372 => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:31.067790 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-eaae960c-e72d-4962-840b-9359b4137ede tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:31.068402 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-eaae960c-e72d-4962-840b-9359b4137ede tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:31.075159 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-eaae960c-e72d-4962-840b-9359b4137ede tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:31.075617 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-eaae960c-e72d-4962-840b-9359b4137ede tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:31.076407 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-eaae960c-e72d-4962-840b-9359b4137ede tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:31.076847 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-eaae960c-e72d-4962-840b-9359b4137ede tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:31.156096 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-eaae960c-e72d-4962-840b-9359b4137ede tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092745 Jun 03 10:06:31.157207 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 468/951] 10.222.0.42 () {58 vars in 1274 bytes} [Fri Jun 3 10:06:31 2022] GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:06:32.483582 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-9a157d7b-d955-4658-868b-8b62f8bc3ee6 req-2b3ad38c-c04d-4036-8d4c-6fb04faba6ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21c2fa33-3843-4029-a7af-ae2571f5a372", "tag": "1622156a-d26f-40fe-89b8-7a97ced62e88"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:06:32.491706 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-9a157d7b-d955-4658-868b-8b62f8bc3ee6 req-2b3ad38c-c04d-4036-8d4c-6fb04faba6ee service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:32.492161 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-9a157d7b-d955-4658-868b-8b62f8bc3ee6 req-2b3ad38c-c04d-4036-8d4c-6fb04faba6ee service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:32.503788 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-9a157d7b-d955-4658-868b-8b62f8bc3ee6 req-2b3ad38c-c04d-4036-8d4c-6fb04faba6ee service nova] Creating event network-changed:1622156a-d26f-40fe-89b8-7a97ced62e88 for instance 21c2fa33-3843-4029-a7af-ae2571f5a372 on hv-cinder-84456 Jun 03 10:06:32.509080 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-9a157d7b-d955-4658-868b-8b62f8bc3ee6 req-2b3ad38c-c04d-4036-8d4c-6fb04faba6ee service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029599 Jun 03 10:06:32.512911 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 484/952] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:06:48.438935 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_api:SELECT=7 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:48.440381 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:SELECT=20 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:48.443794 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_api:SELECT=7 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:48.444279 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-c6cac82a-eb3c-44ab-b809-0bb50d4fee61 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:48.444778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-c6cac82a-eb3c-44ab-b809-0bb50d4fee61 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:48.450147 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=13 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:48.450147 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-1265ced8-8d81-4f9a-b068-988bbf3c4347 req-6012fc0a-31f5-43d0-a3a8-6c6ed1d2cca0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5afad0ea-b328-43cf-8ed2-f500796569b0", "tag": "895de58e-9396-45ee-adb3-b1ce59bb1799"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:06:48.451294 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c6cac82a-eb3c-44ab-b809-0bb50d4fee61 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:48.451848 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c6cac82a-eb3c-44ab-b809-0bb50d4fee61 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:48.452842 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c6cac82a-eb3c-44ab-b809-0bb50d4fee61 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:48.453289 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-c6cac82a-eb3c-44ab-b809-0bb50d4fee61 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:48.459449 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-1265ced8-8d81-4f9a-b068-988bbf3c4347 req-6012fc0a-31f5-43d0-a3a8-6c6ed1d2cca0 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:48.459909 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-1265ced8-8d81-4f9a-b068-988bbf3c4347 req-6012fc0a-31f5-43d0-a3a8-6c6ed1d2cca0 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:48.474499 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-1265ced8-8d81-4f9a-b068-988bbf3c4347 req-6012fc0a-31f5-43d0-a3a8-6c6ed1d2cca0 service nova] Creating event network-changed:895de58e-9396-45ee-adb3-b1ce59bb1799 for instance 5afad0ea-b328-43cf-8ed2-f500796569b0 on hv-cinder-84456 Jun 03 10:06:48.480769 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-1265ced8-8d81-4f9a-b068-988bbf3c4347 req-6012fc0a-31f5-43d0-a3a8-6c6ed1d2cca0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038296 Jun 03 10:06:48.481932 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 485/953] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:06:48.485546 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-c6cac82a-eb3c-44ab-b809-0bb50d4fee61 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Going to try to terminate instance {{(pid=125066) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:06:48.951935 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-c6cac82a-eb3c-44ab-b809-0bb50d4fee61 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 204 len: 0 microversion: 2.1 time: 0.514258 Jun 03 10:06:48.952633 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 469/954] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 3 10:06:48 2022] DELETE /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:06:48.962450 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-0f536a12-f220-441c-82ea-f7b8ef30626d tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:48.963534 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-0f536a12-f220-441c-82ea-f7b8ef30626d tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:48.974223 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0f536a12-f220-441c-82ea-f7b8ef30626d tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:48.974996 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0f536a12-f220-441c-82ea-f7b8ef30626d tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:48.976198 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0f536a12-f220-441c-82ea-f7b8ef30626d tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:48.976796 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0f536a12-f220-441c-82ea-f7b8ef30626d tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:49.155814 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-0f536a12-f220-441c-82ea-f7b8ef30626d tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:49.164751 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-0f536a12-f220-441c-82ea-f7b8ef30626d tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1568 microversion: 2.1 time: 0.207107 Jun 03 10:06:49.165951 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 486/955] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:48 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1568 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:49.753986 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-49b08e82-e4af-4012-82d6-0242a7eefcc5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1879875393", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1365846056", "security_groups": [{"name": "tempest-secgroup-smoke-921144121"}], "block_device_mapping_v2": [{"uuid": "793d342a-da9c-4f54-a878-8031dca8d668", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cdd39ad8-1097-4745-8715-b421d9c9917f"}]}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:06:49.875473 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.network.neutron [None req-49b08e82-e4af-4012-82d6-0242a7eefcc5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] validate_networks() for [('cdd39ad8-1097-4745-8715-b421d9c9917f', None, None, None, None, None)] {{(pid=125066) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 10:06:50.182661 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-ac0ddd11-5c7c-4668-b6de-5647b1c1eff1 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:50.183275 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-ac0ddd11-5c7c-4668-b6de-5647b1c1eff1 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:50.190294 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ac0ddd11-5c7c-4668-b6de-5647b1c1eff1 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:50.190741 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ac0ddd11-5c7c-4668-b6de-5647b1c1eff1 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:50.191496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ac0ddd11-5c7c-4668-b6de-5647b1c1eff1 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:50.191929 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ac0ddd11-5c7c-4668-b6de-5647b1c1eff1 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:50.281635 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-49b08e82-e4af-4012-82d6-0242a7eefcc5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Flavor limits 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 10:06:50.282088 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-49b08e82-e4af-4012-82d6-0242a7eefcc5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Image limits 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 10:06:50.282556 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-49b08e82-e4af-4012-82d6-0242a7eefcc5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Flavor pref 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 10:06:50.282961 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-49b08e82-e4af-4012-82d6-0242a7eefcc5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Image pref 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 10:06:50.283367 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-49b08e82-e4af-4012-82d6-0242a7eefcc5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 10:06:50.293602 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-49b08e82-e4af-4012-82d6-0242a7eefcc5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:50.294138 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-49b08e82-e4af-4012-82d6-0242a7eefcc5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:50.295070 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-49b08e82-e4af-4012-82d6-0242a7eefcc5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:50.295502 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-49b08e82-e4af-4012-82d6-0242a7eefcc5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:50.317234 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-49b08e82-e4af-4012-82d6-0242a7eefcc5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Getting quotas for project 5476f21b29944eb69e32a2d97b328aed. Resources: {'ram', 'instances', 'cores'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:06:50.322045 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-49b08e82-e4af-4012-82d6-0242a7eefcc5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Getting quotas for user 646fecf4405c41a0bc062c6b54fd311c and project 5476f21b29944eb69e32a2d97b328aed. Resources: {'ram', 'instances', 'cores'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:06:50.350827 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-ac0ddd11-5c7c-4668-b6de-5647b1c1eff1 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:50.359571 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-ac0ddd11-5c7c-4668-b6de-5647b1c1eff1 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1449 microversion: 2.1 time: 0.180710 Jun 03 10:06:50.361670 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 487/956] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:50 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1449 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:06:50.389139 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-49b08e82-e4af-4012-82d6-0242a7eefcc5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Going to run 1 instances... {{(pid=125066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 10:06:50.391817 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-49b08e82-e4af-4012-82d6-0242a7eefcc5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: ba348d8e-b108-46ae-8ef2-db977c9ca0d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='793d342a-da9c-4f54-a878-8031dca8d668',volume_size=None,volume_type=None)] {{(pid=125066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 10:06:50.919366 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-49b08e82-e4af-4012-82d6-0242a7eefcc5 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.169997 Jun 03 10:06:50.921595 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 470/957] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 3 10:06:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 1173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 10:06:50.931162 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-5b25ee5c-7733-44ef-a3a2-3f3a0aa494bb tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:50.935817 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-5b25ee5c-7733-44ef-a3a2-3f3a0aa494bb tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: ba348d8e-b108-46ae-8ef2-db977c9ca0d6] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:50.995988 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-5b25ee5c-7733-44ef-a3a2-3f3a0aa494bb tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:51.006289 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-5b25ee5c-7733-44ef-a3a2-3f3a0aa494bb tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6" status: 200 len: 1095 microversion: 2.1 time: 0.078849 Jun 03 10:06:51.006883 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 488/958] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:50 2022] GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6 => generated 1095 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:06:51.170250 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-ae6a0aa4-185f-4a18-bae9-d10a32f066be req-8c7edacb-3f72-4224-ae1e-13b3920f1cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5afad0ea-b328-43cf-8ed2-f500796569b0", "name": "network-vif-deleted", "tag": "895de58e-9396-45ee-adb3-b1ce59bb1799"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:06:51.182502 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-ae6a0aa4-185f-4a18-bae9-d10a32f066be req-8c7edacb-3f72-4224-ae1e-13b3920f1cb9 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:51.183272 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-ae6a0aa4-185f-4a18-bae9-d10a32f066be req-8c7edacb-3f72-4224-ae1e-13b3920f1cb9 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:51.194764 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-ae6a0aa4-185f-4a18-bae9-d10a32f066be req-8c7edacb-3f72-4224-ae1e-13b3920f1cb9 service nova] Creating event network-vif-deleted:895de58e-9396-45ee-adb3-b1ce59bb1799 for instance 5afad0ea-b328-43cf-8ed2-f500796569b0 on hv-cinder-84456 Jun 03 10:06:51.199903 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-ae6a0aa4-185f-4a18-bae9-d10a32f066be req-8c7edacb-3f72-4224-ae1e-13b3920f1cb9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033447 Jun 03 10:06:51.200862 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 471/959] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:06:51.379182 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-9b916a44-055e-48d1-a425-f4c91479147e tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:51.379707 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-9b916a44-055e-48d1-a425-f4c91479147e tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:51.388922 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9b916a44-055e-48d1-a425-f4c91479147e tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:51.389368 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9b916a44-055e-48d1-a425-f4c91479147e tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:51.390161 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9b916a44-055e-48d1-a425-f4c91479147e tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:51.390586 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9b916a44-055e-48d1-a425-f4c91479147e tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:51.452730 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-9b916a44-055e-48d1-a425-f4c91479147e tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:51.460646 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-9b916a44-055e-48d1-a425-f4c91479147e tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1219 microversion: 2.1 time: 0.086493 Jun 03 10:06:51.461234 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 489/960] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:51 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:52.023153 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-4f0dffed-6489-44f0-95d4-df5f4fc86f58 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:52.023837 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-4f0dffed-6489-44f0-95d4-df5f4fc86f58 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: ba348d8e-b108-46ae-8ef2-db977c9ca0d6] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:52.030703 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4f0dffed-6489-44f0-95d4-df5f4fc86f58 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:52.031207 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4f0dffed-6489-44f0-95d4-df5f4fc86f58 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:52.031953 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4f0dffed-6489-44f0-95d4-df5f4fc86f58 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:52.032894 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4f0dffed-6489-44f0-95d4-df5f4fc86f58 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:52.099358 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-4f0dffed-6489-44f0-95d4-df5f4fc86f58 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:52.107068 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-4f0dffed-6489-44f0-95d4-df5f4fc86f58 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6" status: 200 len: 1145 microversion: 2.1 time: 0.088068 Jun 03 10:06:52.107638 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 472/961] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:52 2022] GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6 => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:52.478668 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-b2c84759-15b3-407a-9ae5-cb998605550d tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:52.479328 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-b2c84759-15b3-407a-9ae5-cb998605550d tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:52.486803 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b2c84759-15b3-407a-9ae5-cb998605550d tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:52.487216 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b2c84759-15b3-407a-9ae5-cb998605550d tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:52.487972 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b2c84759-15b3-407a-9ae5-cb998605550d tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:52.488391 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b2c84759-15b3-407a-9ae5-cb998605550d tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:52.523670 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b2c84759-15b3-407a-9ae5-cb998605550d tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:52.524136 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b2c84759-15b3-407a-9ae5-cb998605550d tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:52.524580 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.objects.instance [None req-b2c84759-15b3-407a-9ae5-cb998605550d tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lazy-loading 'fault' on Instance uuid 5afad0ea-b328-43cf-8ed2-f500796569b0 {{(pid=125065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:06:52.571992 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-b2c84759-15b3-407a-9ae5-cb998605550d tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d332241d6f84959880bfa99a24805dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c44b2575d1945e0a100fe081e5af582', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:52.579661 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-b2c84759-15b3-407a-9ae5-cb998605550d tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 200 len: 1224 microversion: 2.1 time: 0.105979 Jun 03 10:06:52.580317 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 490/962] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:52 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 1224 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:53.125552 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-3bbc2057-f306-400e-a0f1-a5f066da2153 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:53.126272 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-3bbc2057-f306-400e-a0f1-a5f066da2153 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: ba348d8e-b108-46ae-8ef2-db977c9ca0d6] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:53.133055 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3bbc2057-f306-400e-a0f1-a5f066da2153 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:53.133505 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3bbc2057-f306-400e-a0f1-a5f066da2153 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:53.134341 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3bbc2057-f306-400e-a0f1-a5f066da2153 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:53.134829 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3bbc2057-f306-400e-a0f1-a5f066da2153 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:53.198448 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-3bbc2057-f306-400e-a0f1-a5f066da2153 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:53.206639 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-3bbc2057-f306-400e-a0f1-a5f066da2153 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6" status: 200 len: 1193 microversion: 2.1 time: 0.085920 Jun 03 10:06:53.207204 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 473/963] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:53 2022] GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6 => generated 1193 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:53.598352 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-27e76e39-231c-42d0-b349-1048b160127f tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:53.599062 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-27e76e39-231c-42d0-b349-1048b160127f tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] [instance: 5afad0ea-b328-43cf-8ed2-f500796569b0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:53.605950 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-27e76e39-231c-42d0-b349-1048b160127f tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:53.606404 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-27e76e39-231c-42d0-b349-1048b160127f tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:53.607178 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-27e76e39-231c-42d0-b349-1048b160127f tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:53.607613 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-27e76e39-231c-42d0-b349-1048b160127f tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:53.635279 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.wsgi [None req-27e76e39-231c-42d0-b349-1048b160127f tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] HTTP exception thrown: Instance 5afad0ea-b328-43cf-8ed2-f500796569b0 could not be found. Jun 03 10:06:53.636942 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-27e76e39-231c-42d0-b349-1048b160127f tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Request method failure captured: Jun 03 10:06:53.636942 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: request: GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 HTTP/1.1 Jun 03 10:06:53.636942 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept: application/json Jun 03 10:06:53.636942 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept-Encoding: identity Jun 03 10:06:53.636942 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Connection: close Jun 03 10:06:53.636942 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Length: 0 Jun 03 10:06:53.636942 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Type: application/json Jun 03 10:06:53.636942 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Host: 10.222.0.42 Jun 03 10:06:53.636942 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Openstack-System-Scope: None Jun 03 10:06:53.636942 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: User-Agent: python-urllib3/1.26.9 Jun 03 10:06:53.636942 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Auth-Token: gAAAAABimdwIxlV-13-PLY_8p7WokmogU4Jbm5E6HjvErSwqyIMszfOXevAdbMfb9g6p7BRuTv522RtQG_etTfcSHDeQubMmHtSCqumgeVOnpNuVwQVQbOZdxu-pY798LtH8-Pq5dndVc_ey2GGbRcs4Jlq7rSvjTvxk5d79Srs9YYllqULNSkc Jun 03 10:06:53.636942 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Id: None Jun 03 10:06:53.636942 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Name: None Jun 03 10:06:53.636942 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Identity-Status: Confirmed Jun 03 10:06:53.636942 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Is-Admin-Project: True Jun 03 10:06:53.636942 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Id: default Jun 03 10:06:53.636942 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Name: Default Jun 03 10:06:53.636942 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Id: 3c44b2575d1945e0a100fe081e5af582 Jun 03 10:06:53.636942 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Name: tempest-TestShelveInstance-1524759694 Jun 03 10:06:53.636942 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Role: member,reader Jun 03 10:06:53.636942 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Roles: member,reader Jun 03 10:06:53.638702 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3c44b2575d1945e0a100fe081e5af582"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3c44b2575d1945e0a100fe081e5af582"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3c44b2575d1945e0a100fe081e5af582", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3c44b2575d1945e0a100fe081e5af582"}]}] Jun 03 10:06:53.638702 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant: tempest-TestShelveInstance-1524759694 Jun 03 10:06:53.638702 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Id: 3c44b2575d1945e0a100fe081e5af582 Jun 03 10:06:53.638702 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Name: tempest-TestShelveInstance-1524759694 Jun 03 10:06:53.638702 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User: tempest-TestShelveInstance-1524759694-project Jun 03 10:06:53.638702 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Id: default Jun 03 10:06:53.638702 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Name: Default Jun 03 10:06:53.638702 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Id: 5d332241d6f84959880bfa99a24805dc Jun 03 10:06:53.638702 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Name: tempest-TestShelveInstance-1524759694-project Jun 03 10:06:53.638702 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: method: > Jun 03 10:06:53.638702 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: exception: Instance 5afad0ea-b328-43cf-8ed2-f500796569b0 could not be found. Jun 03 10:06:53.638702 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: action_args: {'id': '5afad0ea-b328-43cf-8ed2-f500796569b0'} Jun 03 10:06:53.639755 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:06:53.639755 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:06:53.639755 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:06:53.639755 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:06:53.639755 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:06:53.639755 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:06:53.639755 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:06:53.639755 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:06:53.639755 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:06:53.639755 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:06:53.639755 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5afad0ea-b328-43cf-8ed2-f500796569b0 could not be found. Jun 03 10:06:53.639755 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:06:53.639755 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:06:53.639755 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:06:53.639755 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:06:53.639755 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:06:53.639755 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:06:53.639755 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:06:53.639755 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:06:53.639755 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:06:53.641086 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:06:53.641086 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:06:53.641086 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:06:53.641086 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:06:53.641086 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:06:53.641086 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:06:53.641086 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:06:53.641086 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5afad0ea-b328-43cf-8ed2-f500796569b0 could not be found. Jun 03 10:06:53.641086 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:06:53.641086 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:06:53.641086 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:06:53.641086 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:06:53.641086 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:06:53.641086 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:06:53.641086 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:06:53.641086 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:06:53.641086 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5afad0ea-b328-43cf-8ed2-f500796569b0 could not be found. Jun 03 10:06:53.641086 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:06:53.643602 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-27e76e39-231c-42d0-b349-1048b160127f tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Returning 404 to user: Instance 5afad0ea-b328-43cf-8ed2-f500796569b0 could not be found. {{(pid=125065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:06:53.643602 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-27e76e39-231c-42d0-b349-1048b160127f tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0" status: 404 len: 111 microversion: 2.1 time: 0.045126 Jun 03 10:06:53.643602 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 491/964] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:53 2022] GET /compute/v2.1/servers/5afad0ea-b328-43cf-8ed2-f500796569b0 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:06:54.107713 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-1dc5b5f2-b590-4df7-ab06-d5bf94f5ed72 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] Calling method '.version_select at 0x7f8d23ebc790>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:54.216524 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-1dc5b5f2-b590-4df7-ab06-d5bf94f5ed72 tempest-TestShelveInstance-1524759694 tempest-TestShelveInstance-1524759694-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2115358546" status: 202 len: 0 microversion: 2.1 time: 0.122371 Jun 03 10:06:54.223536 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 474/965] 10.222.0.42 () {58 vars in 1253 bytes} [Fri Jun 3 10:06:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2115358546 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:06:54.231034 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-3895e07d-91dc-4c12-88e9-6dae62385702 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:54.231947 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-3895e07d-91dc-4c12-88e9-6dae62385702 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: ba348d8e-b108-46ae-8ef2-db977c9ca0d6] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:54.240749 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3895e07d-91dc-4c12-88e9-6dae62385702 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:54.241699 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3895e07d-91dc-4c12-88e9-6dae62385702 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:54.242853 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3895e07d-91dc-4c12-88e9-6dae62385702 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:54.243459 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-3895e07d-91dc-4c12-88e9-6dae62385702 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:54.345652 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-3895e07d-91dc-4c12-88e9-6dae62385702 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:54.353285 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-3895e07d-91dc-4c12-88e9-6dae62385702 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6" status: 200 len: 1211 microversion: 2.1 time: 0.133209 Jun 03 10:06:54.353855 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 492/966] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:54 2022] GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6 => generated 1211 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:55.370913 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-0ca70113-d6bd-4c2f-a238-c5a8b7ccb578 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:55.372075 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-0ca70113-d6bd-4c2f-a238-c5a8b7ccb578 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: ba348d8e-b108-46ae-8ef2-db977c9ca0d6] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:55.388974 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0ca70113-d6bd-4c2f-a238-c5a8b7ccb578 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:55.389864 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0ca70113-d6bd-4c2f-a238-c5a8b7ccb578 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:55.390855 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0ca70113-d6bd-4c2f-a238-c5a8b7ccb578 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:55.391492 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-0ca70113-d6bd-4c2f-a238-c5a8b7ccb578 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:55.702031 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-0ca70113-d6bd-4c2f-a238-c5a8b7ccb578 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:55.711931 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-0ca70113-d6bd-4c2f-a238-c5a8b7ccb578 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6" status: 200 len: 1266 microversion: 2.1 time: 0.344878 Jun 03 10:06:55.724869 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 475/967] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:55 2022] GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6 => generated 1266 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:55.923468 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-bde0f39d-8501-4773-a3e4-cfdfc79a07dd req-77dd6e67-93b7-4394-8a02-24e42f00943f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba348d8e-b108-46ae-8ef2-db977c9ca0d6", "tag": "ddeb8364-fea9-49e6-8361-912b3e7116bb"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:06:55.935760 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-bde0f39d-8501-4773-a3e4-cfdfc79a07dd req-77dd6e67-93b7-4394-8a02-24e42f00943f service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:55.936244 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-bde0f39d-8501-4773-a3e4-cfdfc79a07dd req-77dd6e67-93b7-4394-8a02-24e42f00943f service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:55.957359 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-bde0f39d-8501-4773-a3e4-cfdfc79a07dd req-77dd6e67-93b7-4394-8a02-24e42f00943f service nova] Creating event network-changed:ddeb8364-fea9-49e6-8361-912b3e7116bb for instance ba348d8e-b108-46ae-8ef2-db977c9ca0d6 on hv-cinder-84456 Jun 03 10:06:55.960217 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-bde0f39d-8501-4773-a3e4-cfdfc79a07dd req-77dd6e67-93b7-4394-8a02-24e42f00943f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046791 Jun 03 10:06:55.961267 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 493/968] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:06:56.732634 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-9b1e6579-2397-4848-aaf8-913ec5a17128 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:56.733760 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-9b1e6579-2397-4848-aaf8-913ec5a17128 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: ba348d8e-b108-46ae-8ef2-db977c9ca0d6] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:56.741845 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9b1e6579-2397-4848-aaf8-913ec5a17128 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:56.742339 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9b1e6579-2397-4848-aaf8-913ec5a17128 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:56.743366 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9b1e6579-2397-4848-aaf8-913ec5a17128 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:56.743812 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-9b1e6579-2397-4848-aaf8-913ec5a17128 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:56.980170 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-9b1e6579-2397-4848-aaf8-913ec5a17128 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:56.994296 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-9b1e6579-2397-4848-aaf8-913ec5a17128 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6" status: 200 len: 1266 microversion: 2.1 time: 0.264400 Jun 03 10:06:56.997968 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 476/969] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:56 2022] GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6 => generated 1266 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:58.013669 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-6905462d-8672-4ab7-bc87-301ec9e5f965 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:58.014491 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-6905462d-8672-4ab7-bc87-301ec9e5f965 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: ba348d8e-b108-46ae-8ef2-db977c9ca0d6] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:58.022391 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6905462d-8672-4ab7-bc87-301ec9e5f965 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:58.024871 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6905462d-8672-4ab7-bc87-301ec9e5f965 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:58.024871 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6905462d-8672-4ab7-bc87-301ec9e5f965 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:58.024871 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6905462d-8672-4ab7-bc87-301ec9e5f965 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:58.265359 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-6905462d-8672-4ab7-bc87-301ec9e5f965 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:58.273955 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-6905462d-8672-4ab7-bc87-301ec9e5f965 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6" status: 200 len: 1266 microversion: 2.1 time: 0.265407 Jun 03 10:06:58.274529 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 494/970] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:58 2022] GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6 => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:59.290568 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-6035d75b-e254-4814-9a10-2e2794d661a6 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:59.291813 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-6035d75b-e254-4814-9a10-2e2794d661a6 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: ba348d8e-b108-46ae-8ef2-db977c9ca0d6] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:59.298641 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6035d75b-e254-4814-9a10-2e2794d661a6 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:59.299097 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6035d75b-e254-4814-9a10-2e2794d661a6 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:59.299871 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6035d75b-e254-4814-9a10-2e2794d661a6 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:59.300313 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6035d75b-e254-4814-9a10-2e2794d661a6 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:59.500047 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-6035d75b-e254-4814-9a10-2e2794d661a6 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:59.512235 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-6035d75b-e254-4814-9a10-2e2794d661a6 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6" status: 200 len: 1266 microversion: 2.1 time: 0.224521 Jun 03 10:06:59.518390 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 477/971] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:59 2022] GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:00.527855 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-741ff9ce-5677-4a5d-92f8-97a09817cd20 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:00.528463 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-741ff9ce-5677-4a5d-92f8-97a09817cd20 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: ba348d8e-b108-46ae-8ef2-db977c9ca0d6] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:00.535156 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-741ff9ce-5677-4a5d-92f8-97a09817cd20 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:00.535602 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-741ff9ce-5677-4a5d-92f8-97a09817cd20 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:00.536361 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-741ff9ce-5677-4a5d-92f8-97a09817cd20 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:00.536794 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-741ff9ce-5677-4a5d-92f8-97a09817cd20 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:00.676752 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-741ff9ce-5677-4a5d-92f8-97a09817cd20 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:00.684236 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-741ff9ce-5677-4a5d-92f8-97a09817cd20 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6" status: 200 len: 1266 microversion: 2.1 time: 0.160252 Jun 03 10:07:00.684920 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 495/972] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:00 2022] GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:01.702000 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-a9293573-fa8e-4f33-9227-62c5b4af59a3 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:01.703019 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-a9293573-fa8e-4f33-9227-62c5b4af59a3 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: ba348d8e-b108-46ae-8ef2-db977c9ca0d6] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:01.706319 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell0:SELECT=2 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:07:01.708581 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell0:SELECT=6 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:07:01.729972 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a9293573-fa8e-4f33-9227-62c5b4af59a3 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:01.730789 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a9293573-fa8e-4f33-9227-62c5b4af59a3 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:01.731840 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a9293573-fa8e-4f33-9227-62c5b4af59a3 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:01.732322 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a9293573-fa8e-4f33-9227-62c5b4af59a3 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:01.920305 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-a9293573-fa8e-4f33-9227-62c5b4af59a3 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:01.930804 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-a9293573-fa8e-4f33-9227-62c5b4af59a3 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6" status: 200 len: 1266 microversion: 2.1 time: 0.232928 Jun 03 10:07:01.932526 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 478/973] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:01 2022] GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:02.954598 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-be904c80-7bda-4be0-957e-780c3b47a9e1 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:02.954598 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-be904c80-7bda-4be0-957e-780c3b47a9e1 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: ba348d8e-b108-46ae-8ef2-db977c9ca0d6] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:02.954598 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell0:SELECT=2 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:07:02.957434 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-be904c80-7bda-4be0-957e-780c3b47a9e1 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:02.957981 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-be904c80-7bda-4be0-957e-780c3b47a9e1 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:02.958804 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-be904c80-7bda-4be0-957e-780c3b47a9e1 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:02.959291 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-be904c80-7bda-4be0-957e-780c3b47a9e1 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:03.094267 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-be904c80-7bda-4be0-957e-780c3b47a9e1 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:03.103709 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-be904c80-7bda-4be0-957e-780c3b47a9e1 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6" status: 200 len: 1266 microversion: 2.1 time: 0.158791 Jun 03 10:07:03.104294 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 496/974] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:02 2022] GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:04.119936 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-6db1b85b-c48c-45ca-a0c0-b0f6d3d1d328 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:04.120556 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-6db1b85b-c48c-45ca-a0c0-b0f6d3d1d328 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: ba348d8e-b108-46ae-8ef2-db977c9ca0d6] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:04.134950 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6db1b85b-c48c-45ca-a0c0-b0f6d3d1d328 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:04.134950 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6db1b85b-c48c-45ca-a0c0-b0f6d3d1d328 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:04.134950 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6db1b85b-c48c-45ca-a0c0-b0f6d3d1d328 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:04.134950 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6db1b85b-c48c-45ca-a0c0-b0f6d3d1d328 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:04.276415 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-6db1b85b-c48c-45ca-a0c0-b0f6d3d1d328 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:04.284312 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-6db1b85b-c48c-45ca-a0c0-b0f6d3d1d328 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6" status: 200 len: 1266 microversion: 2.1 time: 0.168332 Jun 03 10:07:04.286129 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 479/975] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:04 2022] GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:05.301010 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-108c3a1e-fcf9-41a3-9d87-7f44e9c2c230 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:05.302099 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-108c3a1e-fcf9-41a3-9d87-7f44e9c2c230 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: ba348d8e-b108-46ae-8ef2-db977c9ca0d6] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:05.308683 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-108c3a1e-fcf9-41a3-9d87-7f44e9c2c230 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:05.309125 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-108c3a1e-fcf9-41a3-9d87-7f44e9c2c230 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:05.309906 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-108c3a1e-fcf9-41a3-9d87-7f44e9c2c230 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:05.310347 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-108c3a1e-fcf9-41a3-9d87-7f44e9c2c230 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:05.442327 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-108c3a1e-fcf9-41a3-9d87-7f44e9c2c230 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:05.449861 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-108c3a1e-fcf9-41a3-9d87-7f44e9c2c230 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6" status: 200 len: 1266 microversion: 2.1 time: 0.152780 Jun 03 10:07:05.450440 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 497/976] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:05 2022] GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:06.125506 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-2699760e-5cca-4b7f-aff7-e4f075a43bff req-a79c4982-474e-484f-b7d8-1a37a1bc9703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba348d8e-b108-46ae-8ef2-db977c9ca0d6", "name": "network-vif-plugged", "status": "completed", "tag": "ddeb8364-fea9-49e6-8361-912b3e7116bb"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:07:06.134242 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-2699760e-5cca-4b7f-aff7-e4f075a43bff req-a79c4982-474e-484f-b7d8-1a37a1bc9703 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:06.134678 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-2699760e-5cca-4b7f-aff7-e4f075a43bff req-a79c4982-474e-484f-b7d8-1a37a1bc9703 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:06.145726 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-2699760e-5cca-4b7f-aff7-e4f075a43bff req-a79c4982-474e-484f-b7d8-1a37a1bc9703 service nova] Creating event network-vif-plugged:ddeb8364-fea9-49e6-8361-912b3e7116bb for instance ba348d8e-b108-46ae-8ef2-db977c9ca0d6 on hv-cinder-84456 Jun 03 10:07:06.150521 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-2699760e-5cca-4b7f-aff7-e4f075a43bff req-a79c4982-474e-484f-b7d8-1a37a1bc9703 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028751 Jun 03 10:07:06.151095 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 480/977] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:07:06.467187 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-14445abe-9495-422c-a32a-b173e69df78a tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:06.467808 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-14445abe-9495-422c-a32a-b173e69df78a tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: ba348d8e-b108-46ae-8ef2-db977c9ca0d6] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:06.474478 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-14445abe-9495-422c-a32a-b173e69df78a tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:06.474936 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-14445abe-9495-422c-a32a-b173e69df78a tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:06.475708 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-14445abe-9495-422c-a32a-b173e69df78a tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:06.476185 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-14445abe-9495-422c-a32a-b173e69df78a tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:06.650221 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-14445abe-9495-422c-a32a-b173e69df78a tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:06.657803 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-14445abe-9495-422c-a32a-b173e69df78a tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6" status: 200 len: 1266 microversion: 2.1 time: 0.194666 Jun 03 10:07:06.658394 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 498/978] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:06 2022] GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:07.675586 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-4fb8ae47-153c-4eb3-aad3-c0d4017f04ff tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:07.676280 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-4fb8ae47-153c-4eb3-aad3-c0d4017f04ff tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: ba348d8e-b108-46ae-8ef2-db977c9ca0d6] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:07.683631 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4fb8ae47-153c-4eb3-aad3-c0d4017f04ff tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:07.684188 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4fb8ae47-153c-4eb3-aad3-c0d4017f04ff tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:07.684966 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4fb8ae47-153c-4eb3-aad3-c0d4017f04ff tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:07.685401 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4fb8ae47-153c-4eb3-aad3-c0d4017f04ff tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:07.820508 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-4fb8ae47-153c-4eb3-aad3-c0d4017f04ff tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:07.827990 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-4fb8ae47-153c-4eb3-aad3-c0d4017f04ff tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6" status: 200 len: 1266 microversion: 2.1 time: 0.157096 Jun 03 10:07:07.828637 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 481/979] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:07 2022] GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:08.552067 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-f3285319-c132-4406-96f5-e21254b76ab5 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:08.552636 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-f3285319-c132-4406-96f5-e21254b76ab5 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:08.559164 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f3285319-c132-4406-96f5-e21254b76ab5 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:08.559618 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f3285319-c132-4406-96f5-e21254b76ab5 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:08.560389 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f3285319-c132-4406-96f5-e21254b76ab5 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:08.560824 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f3285319-c132-4406-96f5-e21254b76ab5 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:08.585324 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-f3285319-c132-4406-96f5-e21254b76ab5 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372/ips" status: 200 len: 150 microversion: 2.1 time: 0.037179 Jun 03 10:07:08.586052 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 499/980] 10.222.0.42 () {58 vars in 1247 bytes} [Fri Jun 3 10:07:08 2022] GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:07:08.845440 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-d4f37f73-a6d0-4c67-9404-d41e4bc10e89 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:08.851872 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-d4f37f73-a6d0-4c67-9404-d41e4bc10e89 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: ba348d8e-b108-46ae-8ef2-db977c9ca0d6] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:08.852560 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d4f37f73-a6d0-4c67-9404-d41e4bc10e89 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:08.853005 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d4f37f73-a6d0-4c67-9404-d41e4bc10e89 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:08.853763 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d4f37f73-a6d0-4c67-9404-d41e4bc10e89 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:08.854224 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d4f37f73-a6d0-4c67-9404-d41e4bc10e89 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:08.989183 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-d4f37f73-a6d0-4c67-9404-d41e4bc10e89 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:08.996767 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-d4f37f73-a6d0-4c67-9404-d41e4bc10e89 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6" status: 200 len: 1453 microversion: 2.1 time: 0.155226 Jun 03 10:07:08.997506 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 482/981] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:08 2022] GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:09.016587 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-98162ea6-33e1-4dc0-87e9-a771c155ac09 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:09.017192 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-98162ea6-33e1-4dc0-87e9-a771c155ac09 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: ba348d8e-b108-46ae-8ef2-db977c9ca0d6] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:09.023276 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-98162ea6-33e1-4dc0-87e9-a771c155ac09 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:09.023718 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-98162ea6-33e1-4dc0-87e9-a771c155ac09 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:09.024471 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-98162ea6-33e1-4dc0-87e9-a771c155ac09 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:09.024899 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-98162ea6-33e1-4dc0-87e9-a771c155ac09 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:09.154476 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-98162ea6-33e1-4dc0-87e9-a771c155ac09 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:09.162053 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-98162ea6-33e1-4dc0-87e9-a771c155ac09 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6" status: 200 len: 1453 microversion: 2.1 time: 0.149228 Jun 03 10:07:09.162616 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 500/982] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:09 2022] GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:11.215579 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-736769c2-16fb-478e-b48a-2ed75317648c req-b6146055-58ed-4f0e-b298-5eb531cd154c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba348d8e-b108-46ae-8ef2-db977c9ca0d6", "tag": "ddeb8364-fea9-49e6-8361-912b3e7116bb"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:07:11.224510 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-736769c2-16fb-478e-b48a-2ed75317648c req-b6146055-58ed-4f0e-b298-5eb531cd154c service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:11.224954 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-736769c2-16fb-478e-b48a-2ed75317648c req-b6146055-58ed-4f0e-b298-5eb531cd154c service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:11.236578 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-736769c2-16fb-478e-b48a-2ed75317648c req-b6146055-58ed-4f0e-b298-5eb531cd154c service nova] Creating event network-changed:ddeb8364-fea9-49e6-8361-912b3e7116bb for instance ba348d8e-b108-46ae-8ef2-db977c9ca0d6 on hv-cinder-84456 Jun 03 10:07:11.241569 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-736769c2-16fb-478e-b48a-2ed75317648c req-b6146055-58ed-4f0e-b298-5eb531cd154c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029626 Jun 03 10:07:11.242272 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 483/983] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:07:13.590193 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-6f561878-371b-47f5-b935-cb8e816e1021 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0110f999-fea7-4b82-83ec-6f6c06f498af"}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:07:13.591304 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-6f561878-371b-47f5-b935-cb8e816e1021 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:13.598650 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6f561878-371b-47f5-b935-cb8e816e1021 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:13.599103 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6f561878-371b-47f5-b935-cb8e816e1021 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:13.599863 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6f561878-371b-47f5-b935-cb8e816e1021 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:13.600299 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6f561878-371b-47f5-b935-cb8e816e1021 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:14.382718 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-6f561878-371b-47f5-b935-cb8e816e1021 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "POST /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.796259 Jun 03 10:07:14.383424 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 501/984] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jun 3 10:07:13 2022] POST /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372/os-volume_attachments => generated 194 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:07:21.870444 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:07:21.871197 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:07:21.875454 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-137e88d3-b670-4767-b6ef-d6c8945be1ba tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0110f999-fea7-4b82-83ec-6f6c06f498af"}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:07:21.876650 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-137e88d3-b670-4767-b6ef-d6c8945be1ba tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:21.883066 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-137e88d3-b670-4767-b6ef-d6c8945be1ba tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:21.886113 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-137e88d3-b670-4767-b6ef-d6c8945be1ba tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:21.886113 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-137e88d3-b670-4767-b6ef-d6c8945be1ba tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:21.886113 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-137e88d3-b670-4767-b6ef-d6c8945be1ba tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:21.966029 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.wsgi [None req-137e88d3-b670-4767-b6ef-d6c8945be1ba tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] HTTP exception thrown: Invalid volume: volume 0110f999-fea7-4b82-83ec-6f6c06f498af is already attached to instances: 21c2fa33-3843-4029-a7af-ae2571f5a372 Jun 03 10:07:21.967948 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-137e88d3-b670-4767-b6ef-d6c8945be1ba tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Request method failure captured: Jun 03 10:07:21.967948 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: request: POST /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372/os-volume_attachments HTTP/1.1 Jun 03 10:07:21.967948 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept: application/json Jun 03 10:07:21.967948 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept-Encoding: identity Jun 03 10:07:21.967948 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Connection: close Jun 03 10:07:21.967948 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Length: 74 Jun 03 10:07:21.967948 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Type: application/json Jun 03 10:07:21.967948 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Host: 10.222.0.42 Jun 03 10:07:21.967948 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Openstack-System-Scope: None Jun 03 10:07:21.967948 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: User-Agent: python-urllib3/1.26.9 Jun 03 10:07:21.967948 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Auth-Token: gAAAAABimdyERpWAQe95aVogk3CBzbbvoVqsT1mcXcyeAA1KIeWqlrXYLL74Vx2g9GU9bQbymV8F-OiCfQLZd3XmBfURzXWp91tRpkL6WEAH_Q17Tl2wrUlWolA1gi8vDdxsnFf79KdskWgeoWa8fRazmnte5HviUSJ7Rm7SGX5FgU84B4GApr0 Jun 03 10:07:21.967948 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Id: None Jun 03 10:07:21.967948 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Name: None Jun 03 10:07:21.967948 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Identity-Status: Confirmed Jun 03 10:07:21.967948 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Is-Admin-Project: True Jun 03 10:07:21.967948 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Id: default Jun 03 10:07:21.967948 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Name: Default Jun 03 10:07:21.967948 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Id: 3e51010dd5d84daf8aa43859e9e7cb6d Jun 03 10:07:21.967948 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Name: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:07:21.967948 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Role: member,reader Jun 03 10:07:21.967948 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Roles: member,reader Jun 03 10:07:21.969477 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3e51010dd5d84daf8aa43859e9e7cb6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e51010dd5d84daf8aa43859e9e7cb6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3e51010dd5d84daf8aa43859e9e7cb6d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e51010dd5d84daf8aa43859e9e7cb6d"}]}] Jun 03 10:07:21.969477 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:07:21.969477 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Id: 3e51010dd5d84daf8aa43859e9e7cb6d Jun 03 10:07:21.969477 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:07:21.969477 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User: tempest-AttachVolumeNegativeTest-1165735283-project Jun 03 10:07:21.969477 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Id: default Jun 03 10:07:21.969477 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Name: Default Jun 03 10:07:21.969477 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Id: ce77221a2c8d4c4395bed092c1967b28 Jun 03 10:07:21.969477 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Name: tempest-AttachVolumeNegativeTest-1165735283-project Jun 03 10:07:21.969477 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Jun 03 10:07:21.969477 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {"volumeAttachment": {"volumeId": "0110f999-fea7-4b82-83ec-6f6c06f498af"}} Jun 03 10:07:21.969477 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: method: > Jun 03 10:07:21.970821 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: exception: Invalid volume: volume 0110f999-fea7-4b82-83ec-6f6c06f498af is already attached to instances: 21c2fa33-3843-4029-a7af-ae2571f5a372 Jun 03 10:07:21.970821 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: action_args: {'server_id': '21c2fa33-3843-4029-a7af-ae2571f5a372', 'body': {'volumeAttachment': {'volumeId': '0110f999-fea7-4b82-83ec-6f6c06f498af'}}} Jun 03 10:07:21.970821 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:07:21.970821 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:07:21.970821 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 03 10:07:21.970821 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 03 10:07:21.970821 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 03 10:07:21.970821 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 03 10:07:21.970821 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 03 10:07:21.970821 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 03 10:07:21.970821 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 03 10:07:21.970821 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 03 10:07:21.970821 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 03 10:07:21.970821 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 03 10:07:21.970821 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0110f999-fea7-4b82-83ec-6f6c06f498af is already attached to instances: 21c2fa33-3843-4029-a7af-ae2571f5a372 Jun 03 10:07:21.970821 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:07:21.970821 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:07:21.970821 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:07:21.970821 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:07:21.972837 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:07:21.972837 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:07:21.972837 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:07:21.972837 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:07:21.972837 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:07:21.972837 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:07:21.972837 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 10:07:21.972837 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 10:07:21.972837 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 10:07:21.972837 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 10:07:21.972837 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 10:07:21.972837 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 10:07:21.972837 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 03 10:07:21.972837 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 03 10:07:21.972837 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0110f999-fea7-4b82-83ec-6f6c06f498af is already attached to instances: 21c2fa33-3843-4029-a7af-ae2571f5a372 Jun 03 10:07:21.972837 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:07:21.972837 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:07:21.972837 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:07:21.972837 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:07:21.972837 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:07:21.975308 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:07:21.975308 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:07:21.975308 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:07:21.975308 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0110f999-fea7-4b82-83ec-6f6c06f498af is already attached to instances: 21c2fa33-3843-4029-a7af-ae2571f5a372 Jun 03 10:07:21.975308 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:07:21.975308 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-137e88d3-b670-4767-b6ef-d6c8945be1ba tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Returning 400 to user: Invalid volume: volume 0110f999-fea7-4b82-83ec-6f6c06f498af is already attached to instances: 21c2fa33-3843-4029-a7af-ae2571f5a372 {{(pid=125066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:07:21.975308 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-137e88d3-b670-4767-b6ef-d6c8945be1ba tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "POST /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100429 Jun 03 10:07:21.975308 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 484/985] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jun 3 10:07:21 2022] POST /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 03 10:07:22.030605 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-f951c267-604c-4666-9ab3-b00b7bdbbda9 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:22.031188 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-f951c267-604c-4666-9ab3-b00b7bdbbda9 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:22.035381 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_api:SELECT=39 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:07:22.038768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f951c267-604c-4666-9ab3-b00b7bdbbda9 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:22.039340 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f951c267-604c-4666-9ab3-b00b7bdbbda9 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:22.040115 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f951c267-604c-4666-9ab3-b00b7bdbbda9 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:22.040556 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f951c267-604c-4666-9ab3-b00b7bdbbda9 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:22.044380 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:07:22.120422 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.objects.instance [None req-f951c267-604c-4666-9ab3-b00b7bdbbda9 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lazy-loading 'services' on Instance uuid 21c2fa33-3843-4029-a7af-ae2571f5a372 {{(pid=125065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:07:22.314747 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-f951c267-604c-4666-9ab3-b00b7bdbbda9 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "DELETE /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372/os-volume_attachments/0110f999-fea7-4b82-83ec-6f6c06f498af" status: 202 len: 0 microversion: 2.1 time: 0.289043 Jun 03 10:07:22.315336 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 502/986] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jun 3 10:07:22 2022] DELETE /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372/os-volume_attachments/0110f999-fea7-4b82-83ec-6f6c06f498af => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:07:22.324391 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-a9efc3cd-4daf-4279-b4a7-1d8c9065125e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:22.325316 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-a9efc3cd-4daf-4279-b4a7-1d8c9065125e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:22.334325 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a9efc3cd-4daf-4279-b4a7-1d8c9065125e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:22.335060 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a9efc3cd-4daf-4279-b4a7-1d8c9065125e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:22.335925 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a9efc3cd-4daf-4279-b4a7-1d8c9065125e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:22.336369 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a9efc3cd-4daf-4279-b4a7-1d8c9065125e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:22.365255 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-a9efc3cd-4daf-4279-b4a7-1d8c9065125e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045589 Jun 03 10:07:22.365812 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 485/987] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 3 10:07:22 2022] GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:07:23.377812 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-4c52aa57-2035-4951-8ca7-2e07953b7e95 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:23.379740 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-4c52aa57-2035-4951-8ca7-2e07953b7e95 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:23.386859 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4c52aa57-2035-4951-8ca7-2e07953b7e95 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:23.387311 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4c52aa57-2035-4951-8ca7-2e07953b7e95 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:23.388109 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4c52aa57-2035-4951-8ca7-2e07953b7e95 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:23.388544 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4c52aa57-2035-4951-8ca7-2e07953b7e95 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:23.417339 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-4c52aa57-2035-4951-8ca7-2e07953b7e95 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044357 Jun 03 10:07:23.417921 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 503/988] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 3 10:07:23 2022] GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:07:24.429820 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-fa63e2c0-b35e-4385-a385-eb83889cd972 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:24.430788 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-fa63e2c0-b35e-4385-a385-eb83889cd972 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:24.438345 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fa63e2c0-b35e-4385-a385-eb83889cd972 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:24.438791 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fa63e2c0-b35e-4385-a385-eb83889cd972 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:24.439536 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fa63e2c0-b35e-4385-a385-eb83889cd972 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:24.439966 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-fa63e2c0-b35e-4385-a385-eb83889cd972 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:24.467614 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-fa63e2c0-b35e-4385-a385-eb83889cd972 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042899 Jun 03 10:07:24.468159 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 486/989] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 3 10:07:24 2022] GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 10:07:24.525780 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-27852272-ff6e-4a9e-afa4-499ea621a02d tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:24.526357 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-27852272-ff6e-4a9e-afa4-499ea621a02d tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:24.533179 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-27852272-ff6e-4a9e-afa4-499ea621a02d tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:24.533629 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-27852272-ff6e-4a9e-afa4-499ea621a02d tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:24.534430 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-27852272-ff6e-4a9e-afa4-499ea621a02d tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:24.535360 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-27852272-ff6e-4a9e-afa4-499ea621a02d tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:24.561966 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-27852272-ff6e-4a9e-afa4-499ea621a02d tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Going to try to terminate instance {{(pid=125065) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:07:24.961424 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-27852272-ff6e-4a9e-afa4-499ea621a02d tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "DELETE /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372" status: 204 len: 0 microversion: 2.1 time: 0.439667 Jun 03 10:07:24.962042 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 504/990] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 3 10:07:24 2022] DELETE /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:07:24.970518 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-ba5ded3c-1e6c-4a80-9864-12641230b4e3 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:24.971119 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-ba5ded3c-1e6c-4a80-9864-12641230b4e3 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:24.978536 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ba5ded3c-1e6c-4a80-9864-12641230b4e3 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:24.978923 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ba5ded3c-1e6c-4a80-9864-12641230b4e3 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:24.979671 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ba5ded3c-1e6c-4a80-9864-12641230b4e3 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:24.980095 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ba5ded3c-1e6c-4a80-9864-12641230b4e3 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:25.117180 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-ba5ded3c-1e6c-4a80-9864-12641230b4e3 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:25.124860 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-ba5ded3c-1e6c-4a80-9864-12641230b4e3 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372" status: 200 len: 1681 microversion: 2.1 time: 0.158625 Jun 03 10:07:25.125432 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 487/991] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:24 2022] GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:26.142758 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-e364848e-4800-46ea-9ea9-278c8c0d7d7a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:26.143479 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-e364848e-4800-46ea-9ea9-278c8c0d7d7a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:26.150486 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e364848e-4800-46ea-9ea9-278c8c0d7d7a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:26.150933 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e364848e-4800-46ea-9ea9-278c8c0d7d7a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:26.151691 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e364848e-4800-46ea-9ea9-278c8c0d7d7a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:26.152126 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e364848e-4800-46ea-9ea9-278c8c0d7d7a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:26.282092 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-e364848e-4800-46ea-9ea9-278c8c0d7d7a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:26.290550 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-e364848e-4800-46ea-9ea9-278c8c0d7d7a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372" status: 200 len: 1681 microversion: 2.1 time: 0.151944 Jun 03 10:07:26.291129 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 505/992] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:26 2022] GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:27.307626 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-983673f5-c937-4f7a-9450-4e177baeb607 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:27.308282 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-983673f5-c937-4f7a-9450-4e177baeb607 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:27.314773 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-983673f5-c937-4f7a-9450-4e177baeb607 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:27.315227 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-983673f5-c937-4f7a-9450-4e177baeb607 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:27.316578 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-983673f5-c937-4f7a-9450-4e177baeb607 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:27.317021 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-983673f5-c937-4f7a-9450-4e177baeb607 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:27.448232 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-983673f5-c937-4f7a-9450-4e177baeb607 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:27.455819 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-983673f5-c937-4f7a-9450-4e177baeb607 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372" status: 200 len: 1681 microversion: 2.1 time: 0.152041 Jun 03 10:07:27.456388 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 488/993] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:27 2022] GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:28.473791 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-8c2238ad-b095-4e52-9cae-b79bd87c38f6 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:28.474520 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-8c2238ad-b095-4e52-9cae-b79bd87c38f6 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:28.481716 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8c2238ad-b095-4e52-9cae-b79bd87c38f6 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:28.482214 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8c2238ad-b095-4e52-9cae-b79bd87c38f6 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:28.489206 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8c2238ad-b095-4e52-9cae-b79bd87c38f6 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:28.489206 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-8c2238ad-b095-4e52-9cae-b79bd87c38f6 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:28.526421 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-15ed4c57-5a87-4c2e-bed2-dc1b62026570 req-c6cb95ba-bd3b-44a7-8941-b63ca14cc37b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21c2fa33-3843-4029-a7af-ae2571f5a372", "name": "network-vif-deleted", "tag": "1622156a-d26f-40fe-89b8-7a97ced62e88"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:07:28.538344 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-15ed4c57-5a87-4c2e-bed2-dc1b62026570 req-c6cb95ba-bd3b-44a7-8941-b63ca14cc37b service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:28.539008 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-15ed4c57-5a87-4c2e-bed2-dc1b62026570 req-c6cb95ba-bd3b-44a7-8941-b63ca14cc37b service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:28.554286 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-15ed4c57-5a87-4c2e-bed2-dc1b62026570 req-c6cb95ba-bd3b-44a7-8941-b63ca14cc37b service nova] Creating event network-vif-deleted:1622156a-d26f-40fe-89b8-7a97ced62e88 for instance 21c2fa33-3843-4029-a7af-ae2571f5a372 on hv-cinder-84456 Jun 03 10:07:28.555459 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-8c2238ad-b095-4e52-9cae-b79bd87c38f6 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:28.559639 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-15ed4c57-5a87-4c2e-bed2-dc1b62026570 req-c6cb95ba-bd3b-44a7-8941-b63ca14cc37b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037248 Jun 03 10:07:28.560343 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 489/994] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:07:28.564535 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-8c2238ad-b095-4e52-9cae-b79bd87c38f6 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372" status: 200 len: 1614 microversion: 2.1 time: 0.095574 Jun 03 10:07:28.565168 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 506/995] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:28 2022] GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372 => generated 1614 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:29.594558 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-45b5b68f-846d-404d-8f11-470e38a97205 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:29.595258 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-45b5b68f-846d-404d-8f11-470e38a97205 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:29.605675 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-45b5b68f-846d-404d-8f11-470e38a97205 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:29.606161 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-45b5b68f-846d-404d-8f11-470e38a97205 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:29.606956 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-45b5b68f-846d-404d-8f11-470e38a97205 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:29.607388 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-45b5b68f-846d-404d-8f11-470e38a97205 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:29.675863 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-45b5b68f-846d-404d-8f11-470e38a97205 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:29.683769 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-45b5b68f-846d-404d-8f11-470e38a97205 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372" status: 200 len: 1614 microversion: 2.1 time: 0.093501 Jun 03 10:07:29.684347 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 490/996] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:29 2022] GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372 => generated 1614 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:30.700627 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-70262fe3-ed3a-4861-b043-3a949c5a90d8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:30.701242 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-70262fe3-ed3a-4861-b043-3a949c5a90d8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:30.707934 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-70262fe3-ed3a-4861-b043-3a949c5a90d8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:30.708377 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-70262fe3-ed3a-4861-b043-3a949c5a90d8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:30.709148 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-70262fe3-ed3a-4861-b043-3a949c5a90d8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:30.709584 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-70262fe3-ed3a-4861-b043-3a949c5a90d8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:30.741395 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-70262fe3-ed3a-4861-b043-3a949c5a90d8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:30.741859 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-70262fe3-ed3a-4861-b043-3a949c5a90d8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:30.742401 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.objects.instance [None req-70262fe3-ed3a-4861-b043-3a949c5a90d8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lazy-loading 'fault' on Instance uuid 21c2fa33-3843-4029-a7af-ae2571f5a372 {{(pid=125065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:07:30.785118 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-70262fe3-ed3a-4861-b043-3a949c5a90d8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:30.792617 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-70262fe3-ed3a-4861-b043-3a949c5a90d8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372" status: 200 len: 1331 microversion: 2.1 time: 0.095975 Jun 03 10:07:30.793348 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 507/997] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:30 2022] GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372 => generated 1331 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:31.809417 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-de14ef15-7e32-42b8-a731-bfeaeecc28e0 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:31.810058 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-de14ef15-7e32-42b8-a731-bfeaeecc28e0 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:31.816165 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-de14ef15-7e32-42b8-a731-bfeaeecc28e0 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:31.816613 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-de14ef15-7e32-42b8-a731-bfeaeecc28e0 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:31.817367 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-de14ef15-7e32-42b8-a731-bfeaeecc28e0 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:31.817804 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-de14ef15-7e32-42b8-a731-bfeaeecc28e0 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:31.830740 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.wsgi [None req-de14ef15-7e32-42b8-a731-bfeaeecc28e0 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] HTTP exception thrown: Instance 21c2fa33-3843-4029-a7af-ae2571f5a372 could not be found. Jun 03 10:07:31.832353 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-de14ef15-7e32-42b8-a731-bfeaeecc28e0 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Request method failure captured: Jun 03 10:07:31.832353 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: request: GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372 HTTP/1.1 Jun 03 10:07:31.832353 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept: application/json Jun 03 10:07:31.832353 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept-Encoding: identity Jun 03 10:07:31.832353 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Connection: close Jun 03 10:07:31.832353 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Length: 0 Jun 03 10:07:31.832353 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Type: application/json Jun 03 10:07:31.832353 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Host: 10.222.0.42 Jun 03 10:07:31.832353 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Openstack-System-Scope: None Jun 03 10:07:31.832353 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: User-Agent: python-urllib3/1.26.9 Jun 03 10:07:31.832353 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Auth-Token: gAAAAABimdyERpWAQe95aVogk3CBzbbvoVqsT1mcXcyeAA1KIeWqlrXYLL74Vx2g9GU9bQbymV8F-OiCfQLZd3XmBfURzXWp91tRpkL6WEAH_Q17Tl2wrUlWolA1gi8vDdxsnFf79KdskWgeoWa8fRazmnte5HviUSJ7Rm7SGX5FgU84B4GApr0 Jun 03 10:07:31.832353 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Id: None Jun 03 10:07:31.832353 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Name: None Jun 03 10:07:31.832353 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Identity-Status: Confirmed Jun 03 10:07:31.832353 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Is-Admin-Project: True Jun 03 10:07:31.832353 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Id: default Jun 03 10:07:31.832353 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Name: Default Jun 03 10:07:31.832353 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Id: 3e51010dd5d84daf8aa43859e9e7cb6d Jun 03 10:07:31.832353 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Name: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:07:31.832353 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Role: member,reader Jun 03 10:07:31.832353 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Roles: member,reader Jun 03 10:07:31.840635 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3e51010dd5d84daf8aa43859e9e7cb6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e51010dd5d84daf8aa43859e9e7cb6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3e51010dd5d84daf8aa43859e9e7cb6d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e51010dd5d84daf8aa43859e9e7cb6d"}]}] Jun 03 10:07:31.840635 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:07:31.840635 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Id: 3e51010dd5d84daf8aa43859e9e7cb6d Jun 03 10:07:31.840635 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:07:31.840635 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User: tempest-AttachVolumeNegativeTest-1165735283-project Jun 03 10:07:31.840635 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Id: default Jun 03 10:07:31.840635 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Name: Default Jun 03 10:07:31.840635 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Id: ce77221a2c8d4c4395bed092c1967b28 Jun 03 10:07:31.840635 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Name: tempest-AttachVolumeNegativeTest-1165735283-project Jun 03 10:07:31.840635 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: method: > Jun 03 10:07:31.840635 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: exception: Instance 21c2fa33-3843-4029-a7af-ae2571f5a372 could not be found. Jun 03 10:07:31.840635 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: action_args: {'id': '21c2fa33-3843-4029-a7af-ae2571f5a372'} Jun 03 10:07:31.841705 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:07:31.841705 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:07:31.841705 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:07:31.841705 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:07:31.841705 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:07:31.841705 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:07:31.841705 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:07:31.841705 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:07:31.841705 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:07:31.841705 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:07:31.841705 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21c2fa33-3843-4029-a7af-ae2571f5a372 could not be found. Jun 03 10:07:31.841705 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:07:31.841705 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:07:31.841705 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:07:31.841705 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:07:31.841705 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:07:31.841705 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:07:31.841705 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:07:31.841705 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:07:31.841705 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:07:31.843505 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:07:31.843505 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:07:31.843505 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:07:31.843505 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:07:31.843505 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:07:31.843505 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:07:31.843505 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:07:31.843505 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21c2fa33-3843-4029-a7af-ae2571f5a372 could not be found. Jun 03 10:07:31.843505 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:07:31.843505 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:07:31.843505 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:07:31.843505 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:07:31.843505 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:07:31.843505 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:07:31.843505 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:07:31.843505 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:07:31.843505 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21c2fa33-3843-4029-a7af-ae2571f5a372 could not be found. Jun 03 10:07:31.843505 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:07:31.845114 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-de14ef15-7e32-42b8-a731-bfeaeecc28e0 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Returning 404 to user: Instance 21c2fa33-3843-4029-a7af-ae2571f5a372 could not be found. {{(pid=125066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:07:31.845114 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-de14ef15-7e32-42b8-a731-bfeaeecc28e0 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372" status: 404 len: 111 microversion: 2.1 time: 0.027980 Jun 03 10:07:31.845114 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 491/998] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:31 2022] GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:07:31.845413 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-1a5c6d38-6feb-45e7-bb53-7953f0a10b1c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '.version_select at 0x7f8d237695e0>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:32.054380 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-1a5c6d38-6feb-45e7-bb53-7953f0a10b1c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1367712060" status: 202 len: 0 microversion: 2.1 time: 0.215704 Jun 03 10:07:32.055002 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 508/999] 10.222.0.42 () {58 vars in 1220 bytes} [Fri Jun 3 10:07:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1367712060 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:07:32.926975 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-03d2a57d-a0b2-4a6f-bfc7-e84b6c0bccd3 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Action: 'create', calling method: .version_select at 0x7f8d23ecf5e0>, body: {"keypair": {"name": "tempest-keypair-72091146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFZ0uCtL0EJX8n1DQ69eunifJhF1lhSgclwz+8S4z89ZvOZ0tcy1fLJnsJxgwFoIahP6CACrzmaKuNEhDNLgIBevAWbRQBsaf3Cv9ZVAYW4oryVizjV2Eb9xwH6eSgmJg=="}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:07:32.941070 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-03d2a57d-a0b2-4a6f-bfc7-e84b6c0bccd3 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Getting quotas for project 3e51010dd5d84daf8aa43859e9e7cb6d. Resources: {'key_pairs'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:07:32.945421 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-03d2a57d-a0b2-4a6f-bfc7-e84b6c0bccd3 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Getting quotas for user ce77221a2c8d4c4395bed092c1967b28 and project 3e51010dd5d84daf8aa43859e9e7cb6d. Resources: {'key_pairs'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:07:33.060029 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-03d2a57d-a0b2-4a6f-bfc7-e84b6c0bccd3 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.137396 Jun 03 10:07:33.060655 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 492/1000] 10.222.0.42 () {60 vars in 1158 bytes} [Fri Jun 3 10:07:32 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:07:35.307891 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-6f09757d-253d-4a1e-90ca-d794fba0984f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-390827039", "imageRef": "0d2dd03b-4531-46f3-88da-0380e97b1bd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "284be7b5-7c4f-4f54-b772-bb0f4e7cb533"}], "security_groups": [{"name": "tempest-securitygroup--288961213"}], "key_name": "tempest-keypair-72091146", "user_data": "}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:07:35.658535 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.network.neutron [None req-6f09757d-253d-4a1e-90ca-d794fba0984f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] validate_networks() for [('284be7b5-7c4f-4f54-b772-bb0f4e7cb533', None, None, None, None, None)] {{(pid=125065) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 10:07:36.014434 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-6f09757d-253d-4a1e-90ca-d794fba0984f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Flavor limits 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 10:07:36.014859 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-6f09757d-253d-4a1e-90ca-d794fba0984f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Image limits 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 10:07:36.015331 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-6f09757d-253d-4a1e-90ca-d794fba0984f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Flavor pref 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 10:07:36.015738 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-6f09757d-253d-4a1e-90ca-d794fba0984f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Image pref 0:0:0 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 10:07:36.016166 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.virt.hardware [None req-6f09757d-253d-4a1e-90ca-d794fba0984f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 10:07:36.025628 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6f09757d-253d-4a1e-90ca-d794fba0984f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:36.026113 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6f09757d-253d-4a1e-90ca-d794fba0984f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:36.026914 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6f09757d-253d-4a1e-90ca-d794fba0984f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:36.027360 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6f09757d-253d-4a1e-90ca-d794fba0984f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:36.044338 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.quota [None req-6f09757d-253d-4a1e-90ca-d794fba0984f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Getting quotas for project 3e51010dd5d84daf8aa43859e9e7cb6d. Resources: {'ram', 'instances', 'cores'} {{(pid=125065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:07:36.048315 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.quota [None req-6f09757d-253d-4a1e-90ca-d794fba0984f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Getting quotas for user ce77221a2c8d4c4395bed092c1967b28 and project 3e51010dd5d84daf8aa43859e9e7cb6d. Resources: {'ram', 'instances', 'cores'} {{(pid=125065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:07:36.059268 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-6f09757d-253d-4a1e-90ca-d794fba0984f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Going to run 1 instances... {{(pid=125065) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 10:07:36.061499 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-6f09757d-253d-4a1e-90ca-d794fba0984f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0d2dd03b-4531-46f3-88da-0380e97b1bd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 10:07:36.191589 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-6f09757d-253d-4a1e-90ca-d794fba0984f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.887820 Jun 03 10:07:36.192737 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 509/1001] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 3 10:07:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 10:07:36.202679 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-2e06f477-fb92-4efa-9daa-afe3550533af tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:36.203284 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-2e06f477-fb92-4efa-9daa-afe3550533af tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:36.258853 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-2e06f477-fb92-4efa-9daa-afe3550533af tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:36.265551 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-2e06f477-fb92-4efa-9daa-afe3550533af tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286" status: 200 len: 1239 microversion: 2.1 time: 0.066823 Jun 03 10:07:36.266162 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 493/1002] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:36 2022] GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286 => generated 1239 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:37.282775 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-bbc69303-b285-4178-adc7-873b9b492322 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:37.283386 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-bbc69303-b285-4178-adc7-873b9b492322 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:37.290718 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-bbc69303-b285-4178-adc7-873b9b492322 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:37.291159 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-bbc69303-b285-4178-adc7-873b9b492322 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:37.291916 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-bbc69303-b285-4178-adc7-873b9b492322 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:37.292346 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-bbc69303-b285-4178-adc7-873b9b492322 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:37.353652 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-bbc69303-b285-4178-adc7-873b9b492322 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:37.361192 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-bbc69303-b285-4178-adc7-873b9b492322 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286" status: 200 len: 1243 microversion: 2.1 time: 0.082302 Jun 03 10:07:37.362627 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 510/1003] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:37 2022] GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286 => generated 1243 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:38.378740 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-176ce4e4-f00f-4808-9d33-8dfe2f4c553a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:38.379918 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-176ce4e4-f00f-4808-9d33-8dfe2f4c553a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:38.386851 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-176ce4e4-f00f-4808-9d33-8dfe2f4c553a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:38.387306 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-176ce4e4-f00f-4808-9d33-8dfe2f4c553a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:38.388240 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-176ce4e4-f00f-4808-9d33-8dfe2f4c553a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:38.388640 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-176ce4e4-f00f-4808-9d33-8dfe2f4c553a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:38.462468 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-176ce4e4-f00f-4808-9d33-8dfe2f4c553a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:38.470020 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-176ce4e4-f00f-4808-9d33-8dfe2f4c553a tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286" status: 200 len: 1299 microversion: 2.1 time: 0.095330 Jun 03 10:07:38.480634 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 494/1004] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:38 2022] GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286 => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:39.486960 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-0772007c-28d4-41f1-abf6-303a841e09f1 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:39.487477 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-0772007c-28d4-41f1-abf6-303a841e09f1 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:39.494853 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0772007c-28d4-41f1-abf6-303a841e09f1 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:39.495306 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0772007c-28d4-41f1-abf6-303a841e09f1 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:39.496101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0772007c-28d4-41f1-abf6-303a841e09f1 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:39.496542 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0772007c-28d4-41f1-abf6-303a841e09f1 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:39.690711 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-0772007c-28d4-41f1-abf6-303a841e09f1 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:39.698456 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-0772007c-28d4-41f1-abf6-303a841e09f1 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286" status: 200 len: 1364 microversion: 2.1 time: 0.215473 Jun 03 10:07:39.699024 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 511/1005] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:39 2022] GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286 => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:40.130882 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-663195a0-6662-4081-a790-3c9ae948fa13 req-5b4015e0-065e-4164-8991-00b3f28cb5e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efe3cd1b-2870-4ad9-8299-bf2eb727a286", "tag": "c1c2c52c-81ea-4785-aff0-e8e7fa7ed389"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:07:40.140125 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-663195a0-6662-4081-a790-3c9ae948fa13 req-5b4015e0-065e-4164-8991-00b3f28cb5e3 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:40.140572 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-663195a0-6662-4081-a790-3c9ae948fa13 req-5b4015e0-065e-4164-8991-00b3f28cb5e3 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:40.153658 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-663195a0-6662-4081-a790-3c9ae948fa13 req-5b4015e0-065e-4164-8991-00b3f28cb5e3 service nova] Creating event network-changed:c1c2c52c-81ea-4785-aff0-e8e7fa7ed389 for instance efe3cd1b-2870-4ad9-8299-bf2eb727a286 on hv-cinder-84456 Jun 03 10:07:40.159519 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-663195a0-6662-4081-a790-3c9ae948fa13 req-5b4015e0-065e-4164-8991-00b3f28cb5e3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035999 Jun 03 10:07:40.160140 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 495/1006] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:07:40.716380 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-70b1763b-5ef1-48c1-a611-6630ab2a665c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:40.718377 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-70b1763b-5ef1-48c1-a611-6630ab2a665c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:40.725096 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-70b1763b-5ef1-48c1-a611-6630ab2a665c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:40.725548 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-70b1763b-5ef1-48c1-a611-6630ab2a665c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:40.726350 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-70b1763b-5ef1-48c1-a611-6630ab2a665c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:40.726787 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-70b1763b-5ef1-48c1-a611-6630ab2a665c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:40.924083 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-70b1763b-5ef1-48c1-a611-6630ab2a665c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:40.931575 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-70b1763b-5ef1-48c1-a611-6630ab2a665c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286" status: 200 len: 1364 microversion: 2.1 time: 0.219729 Jun 03 10:07:40.932138 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 512/1007] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:40 2022] GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286 => generated 1364 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:41.949917 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-918b21f4-34f7-4647-bdf4-d5326b5431a8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:41.950615 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-918b21f4-34f7-4647-bdf4-d5326b5431a8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:41.956913 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-918b21f4-34f7-4647-bdf4-d5326b5431a8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:41.957394 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-918b21f4-34f7-4647-bdf4-d5326b5431a8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:41.958188 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-918b21f4-34f7-4647-bdf4-d5326b5431a8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:41.958659 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-918b21f4-34f7-4647-bdf4-d5326b5431a8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:42.089222 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-918b21f4-34f7-4647-bdf4-d5326b5431a8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:42.096665 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-918b21f4-34f7-4647-bdf4-d5326b5431a8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286" status: 200 len: 1364 microversion: 2.1 time: 0.151507 Jun 03 10:07:42.097230 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 496/1008] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:41 2022] GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:43.112650 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-4e4c3ada-f9e7-471a-8db8-b044ceb73354 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:43.113371 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-4e4c3ada-f9e7-471a-8db8-b044ceb73354 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:43.120735 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4e4c3ada-f9e7-471a-8db8-b044ceb73354 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:43.121191 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4e4c3ada-f9e7-471a-8db8-b044ceb73354 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:43.124756 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4e4c3ada-f9e7-471a-8db8-b044ceb73354 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:43.124756 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-4e4c3ada-f9e7-471a-8db8-b044ceb73354 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:43.267288 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-4e4c3ada-f9e7-471a-8db8-b044ceb73354 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:43.275471 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-4e4c3ada-f9e7-471a-8db8-b044ceb73354 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286" status: 200 len: 1364 microversion: 2.1 time: 0.166791 Jun 03 10:07:43.276098 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 513/1009] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:43 2022] GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:44.292144 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-cdd506ac-67ab-4e8d-9086-879df1574104 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:44.292764 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-cdd506ac-67ab-4e8d-9086-879df1574104 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:44.299328 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-cdd506ac-67ab-4e8d-9086-879df1574104 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:44.299774 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-cdd506ac-67ab-4e8d-9086-879df1574104 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:44.300527 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-cdd506ac-67ab-4e8d-9086-879df1574104 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:44.300992 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-cdd506ac-67ab-4e8d-9086-879df1574104 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:44.459653 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-cdd506ac-67ab-4e8d-9086-879df1574104 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:44.467002 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-cdd506ac-67ab-4e8d-9086-879df1574104 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286" status: 200 len: 1364 microversion: 2.1 time: 0.178714 Jun 03 10:07:44.467567 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 497/1010] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:44 2022] GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:45.483721 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-a8701366-e0fc-4435-bc3d-87a4e4646b42 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:45.484335 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-a8701366-e0fc-4435-bc3d-87a4e4646b42 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:45.491837 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a8701366-e0fc-4435-bc3d-87a4e4646b42 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:45.492292 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a8701366-e0fc-4435-bc3d-87a4e4646b42 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:45.493063 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a8701366-e0fc-4435-bc3d-87a4e4646b42 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:45.493505 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-a8701366-e0fc-4435-bc3d-87a4e4646b42 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:45.633871 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-a8701366-e0fc-4435-bc3d-87a4e4646b42 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:45.641423 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-a8701366-e0fc-4435-bc3d-87a4e4646b42 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286" status: 200 len: 1364 microversion: 2.1 time: 0.161688 Jun 03 10:07:45.642027 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 514/1011] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:45 2022] GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:45.873920 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-802f964b-5325-4fce-ab79-54a1fcb069b3 req-76923f5a-be32-4c3a-8334-369446e3ec29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efe3cd1b-2870-4ad9-8299-bf2eb727a286", "name": "network-vif-plugged", "status": "completed", "tag": "c1c2c52c-81ea-4785-aff0-e8e7fa7ed389"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:07:45.884205 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-802f964b-5325-4fce-ab79-54a1fcb069b3 req-76923f5a-be32-4c3a-8334-369446e3ec29 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:45.884850 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-802f964b-5325-4fce-ab79-54a1fcb069b3 req-76923f5a-be32-4c3a-8334-369446e3ec29 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:45.897091 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-802f964b-5325-4fce-ab79-54a1fcb069b3 req-76923f5a-be32-4c3a-8334-369446e3ec29 service nova] Creating event network-vif-plugged:c1c2c52c-81ea-4785-aff0-e8e7fa7ed389 for instance efe3cd1b-2870-4ad9-8299-bf2eb727a286 on hv-cinder-84456 Jun 03 10:07:45.902312 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-802f964b-5325-4fce-ab79-54a1fcb069b3 req-76923f5a-be32-4c3a-8334-369446e3ec29 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032691 Jun 03 10:07:45.903250 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 498/1012] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:07:46.659107 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-050dc9b8-7f2c-493c-920f-42f4869815a5 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:46.659744 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-050dc9b8-7f2c-493c-920f-42f4869815a5 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:46.662441 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell0:SELECT=2 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:07:46.663126 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell0:SELECT=6 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:07:46.668525 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-050dc9b8-7f2c-493c-920f-42f4869815a5 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:46.668976 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-050dc9b8-7f2c-493c-920f-42f4869815a5 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:46.669745 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-050dc9b8-7f2c-493c-920f-42f4869815a5 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:46.670252 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-050dc9b8-7f2c-493c-920f-42f4869815a5 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:46.815720 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-050dc9b8-7f2c-493c-920f-42f4869815a5 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:46.820086 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-050dc9b8-7f2c-493c-920f-42f4869815a5 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286" status: 200 len: 1364 microversion: 2.1 time: 0.164904 Jun 03 10:07:46.820659 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 515/1013] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:46 2022] GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:47.833915 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell0:SELECT=6 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:07:47.840317 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-3f916de0-3181-49f1-a5b9-aad3e06b9fa7 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:47.841123 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-3f916de0-3181-49f1-a5b9-aad3e06b9fa7 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:47.847721 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3f916de0-3181-49f1-a5b9-aad3e06b9fa7 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:47.848505 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3f916de0-3181-49f1-a5b9-aad3e06b9fa7 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:47.849431 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3f916de0-3181-49f1-a5b9-aad3e06b9fa7 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:47.850179 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3f916de0-3181-49f1-a5b9-aad3e06b9fa7 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:47.989180 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-3f916de0-3181-49f1-a5b9-aad3e06b9fa7 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:47.997322 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-3f916de0-3181-49f1-a5b9-aad3e06b9fa7 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286" status: 200 len: 1553 microversion: 2.1 time: 0.164345 Jun 03 10:07:47.998187 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 499/1014] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:47 2022] GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286 => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:48.015842 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-6b88afc7-c34d-483f-aec9-3b38ebe885b1 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:48.016438 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-6b88afc7-c34d-483f-aec9-3b38ebe885b1 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:48.025271 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6b88afc7-c34d-483f-aec9-3b38ebe885b1 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:48.026524 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6b88afc7-c34d-483f-aec9-3b38ebe885b1 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:48.027318 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6b88afc7-c34d-483f-aec9-3b38ebe885b1 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:48.027767 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-6b88afc7-c34d-483f-aec9-3b38ebe885b1 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:48.117860 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-6b88afc7-c34d-483f-aec9-3b38ebe885b1 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106310 Jun 03 10:07:48.118695 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 516/1015] 10.222.0.42 () {58 vars in 1274 bytes} [Fri Jun 3 10:07:48 2022] GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:07:49.204642 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-e0e1c9f2-41f5-47b7-9855-d80cec6c1907 req-3bff0411-8d2e-4006-9914-f487bcd17e50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efe3cd1b-2870-4ad9-8299-bf2eb727a286", "tag": "c1c2c52c-81ea-4785-aff0-e8e7fa7ed389"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:07:49.218502 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-e0e1c9f2-41f5-47b7-9855-d80cec6c1907 req-3bff0411-8d2e-4006-9914-f487bcd17e50 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:49.219505 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-e0e1c9f2-41f5-47b7-9855-d80cec6c1907 req-3bff0411-8d2e-4006-9914-f487bcd17e50 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:49.255537 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-e0e1c9f2-41f5-47b7-9855-d80cec6c1907 req-3bff0411-8d2e-4006-9914-f487bcd17e50 service nova] Creating event network-changed:c1c2c52c-81ea-4785-aff0-e8e7fa7ed389 for instance efe3cd1b-2870-4ad9-8299-bf2eb727a286 on hv-cinder-84456 Jun 03 10:07:49.272571 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-e0e1c9f2-41f5-47b7-9855-d80cec6c1907 req-3bff0411-8d2e-4006-9914-f487bcd17e50 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075135 Jun 03 10:07:49.276503 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 500/1016] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:08:07.624391 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:08:07.625215 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:08:07.629118 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-325e1a34-7954-419a-acc2-d688f9eccc62 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Action: 'create', calling method: .version_select at 0x7f8d3516ce50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-720580462", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQRI2go4q1WGOgj5Hb3+F8aiiM3LnoKv2ie+Xge7/0kfe3xPKrHrZJCU7a1jqt5wz62S5C0fsimX1sAKDdAlzfr/2Caj7dFxfZ9DAiyKYTn+jSEvYzpWspHN0wjRoETUw=="}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:08:07.643483 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.quota [None req-325e1a34-7954-419a-acc2-d688f9eccc62 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Getting quotas for project bc1aca15157e45bf95284345dcabf101. Resources: {'key_pairs'} {{(pid=125065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:08:07.647911 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.quota [None req-325e1a34-7954-419a-acc2-d688f9eccc62 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Getting quotas for user 0b94fa871aee4c35851e6e939838d2f6 and project bc1aca15157e45bf95284345dcabf101. Resources: {'key_pairs'} {{(pid=125065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:08:07.757162 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-325e1a34-7954-419a-acc2-d688f9eccc62 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.134061 Jun 03 10:08:07.757762 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 517/1017] 10.222.0.42 () {60 vars in 1158 bytes} [Fri Jun 3 10:08:07 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:08:07.803155 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:08:07.803906 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:SELECT=70 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:08:07.807968 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-4fc5e1e7-7da7-407e-8d40-7023de164eb9 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2144910379", "imageRef": "55814112-0141-4ac3-a068-aa3e19a18fe9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-720580462", "networks": [{"uuid": "710d39f8-9101-4e3d-baf0-3780f66e0120"}]}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:08:07.858594 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.network.neutron [None req-4fc5e1e7-7da7-407e-8d40-7023de164eb9 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] validate_networks() for [('710d39f8-9101-4e3d-baf0-3780f66e0120', None, None, None, None, None)] {{(pid=125066) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 10:08:08.219480 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-4fc5e1e7-7da7-407e-8d40-7023de164eb9 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Flavor limits 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 10:08:08.219934 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-4fc5e1e7-7da7-407e-8d40-7023de164eb9 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Image limits 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 10:08:08.220405 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-4fc5e1e7-7da7-407e-8d40-7023de164eb9 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Flavor pref 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 10:08:08.220814 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-4fc5e1e7-7da7-407e-8d40-7023de164eb9 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Image pref 0:0:0 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 10:08:08.221225 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.virt.hardware [None req-4fc5e1e7-7da7-407e-8d40-7023de164eb9 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 10:08:08.230941 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4fc5e1e7-7da7-407e-8d40-7023de164eb9 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:08.233020 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4fc5e1e7-7da7-407e-8d40-7023de164eb9 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:08.233020 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4fc5e1e7-7da7-407e-8d40-7023de164eb9 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:08.233020 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4fc5e1e7-7da7-407e-8d40-7023de164eb9 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:08.249394 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-4fc5e1e7-7da7-407e-8d40-7023de164eb9 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Getting quotas for project bc1aca15157e45bf95284345dcabf101. Resources: {'ram', 'instances', 'cores'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:08:08.253378 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.quota [None req-4fc5e1e7-7da7-407e-8d40-7023de164eb9 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Getting quotas for user 0b94fa871aee4c35851e6e939838d2f6 and project bc1aca15157e45bf95284345dcabf101. Resources: {'ram', 'instances', 'cores'} {{(pid=125066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:08:08.264592 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-4fc5e1e7-7da7-407e-8d40-7023de164eb9 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Going to run 1 instances... {{(pid=125066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 10:08:08.266966 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-4fc5e1e7-7da7-407e-8d40-7023de164eb9 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='55814112-0141-4ac3-a068-aa3e19a18fe9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 10:08:08.396311 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-4fc5e1e7-7da7-407e-8d40-7023de164eb9 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594667 Jun 03 10:08:08.396886 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 501/1018] 10.222.0.42 () {60 vars in 1146 bytes} [Fri Jun 3 10:08:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 10:08:08.407819 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-17c282fe-646d-4d40-8910-dae670ab8cc6 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:08.408432 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-17c282fe-646d-4d40-8910-dae670ab8cc6 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:08.468128 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-17c282fe-646d-4d40-8910-dae670ab8cc6 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:08.478590 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-17c282fe-646d-4d40-8910-dae670ab8cc6 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1258 microversion: 2.1 time: 0.072036 Jun 03 10:08:08.478590 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 518/1019] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:08 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:09.492476 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-2a39d5d2-cab7-4f34-bf3a-1fc73c969af9 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:09.493081 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-2a39d5d2-cab7-4f34-bf3a-1fc73c969af9 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:09.500301 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2a39d5d2-cab7-4f34-bf3a-1fc73c969af9 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:09.507735 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2a39d5d2-cab7-4f34-bf3a-1fc73c969af9 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:09.507735 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2a39d5d2-cab7-4f34-bf3a-1fc73c969af9 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:09.507735 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-2a39d5d2-cab7-4f34-bf3a-1fc73c969af9 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:09.563800 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-2a39d5d2-cab7-4f34-bf3a-1fc73c969af9 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:09.572022 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-2a39d5d2-cab7-4f34-bf3a-1fc73c969af9 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1262 microversion: 2.1 time: 0.083894 Jun 03 10:08:09.572596 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 502/1020] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:09 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:10.589097 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-f1ed9780-c66f-4f9a-acb9-309f55c42c01 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:10.589742 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-f1ed9780-c66f-4f9a-acb9-309f55c42c01 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:10.597114 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f1ed9780-c66f-4f9a-acb9-309f55c42c01 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:10.597567 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f1ed9780-c66f-4f9a-acb9-309f55c42c01 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:10.598358 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f1ed9780-c66f-4f9a-acb9-309f55c42c01 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:10.598826 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f1ed9780-c66f-4f9a-acb9-309f55c42c01 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:10.677794 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-f1ed9780-c66f-4f9a-acb9-309f55c42c01 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:10.685446 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-f1ed9780-c66f-4f9a-acb9-309f55c42c01 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1318 microversion: 2.1 time: 0.101167 Jun 03 10:08:10.686040 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 519/1021] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:10 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1318 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:11.705638 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-ad62b69d-679c-4614-8ebe-2049250ef408 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:11.706502 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-ad62b69d-679c-4614-8ebe-2049250ef408 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:11.723605 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ad62b69d-679c-4614-8ebe-2049250ef408 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:11.724540 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ad62b69d-679c-4614-8ebe-2049250ef408 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:11.726442 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ad62b69d-679c-4614-8ebe-2049250ef408 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:11.727391 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ad62b69d-679c-4614-8ebe-2049250ef408 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:11.941713 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-ad62b69d-679c-4614-8ebe-2049250ef408 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:11.950174 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-ad62b69d-679c-4614-8ebe-2049250ef408 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1358 microversion: 2.1 time: 0.250458 Jun 03 10:08:11.963327 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 503/1022] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:11 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1358 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:12.968896 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-519aa354-1137-4d7f-8736-719c7f8aec6a tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:12.970191 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-519aa354-1137-4d7f-8736-719c7f8aec6a tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:12.983421 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-519aa354-1137-4d7f-8736-719c7f8aec6a tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:12.983421 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-519aa354-1137-4d7f-8736-719c7f8aec6a tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:12.983421 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-519aa354-1137-4d7f-8736-719c7f8aec6a tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:12.983421 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-519aa354-1137-4d7f-8736-719c7f8aec6a tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:13.304185 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-519aa354-1137-4d7f-8736-719c7f8aec6a tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:13.313999 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-519aa354-1137-4d7f-8736-719c7f8aec6a tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1358 microversion: 2.1 time: 0.348895 Jun 03 10:08:13.314991 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 520/1023] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:12 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1358 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:14.332091 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-ba8eebc6-93b5-43b4-b2b9-4916a6b76597 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:14.332819 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-ba8eebc6-93b5-43b4-b2b9-4916a6b76597 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:14.340163 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ba8eebc6-93b5-43b4-b2b9-4916a6b76597 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:14.340759 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ba8eebc6-93b5-43b4-b2b9-4916a6b76597 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:14.341641 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ba8eebc6-93b5-43b4-b2b9-4916a6b76597 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:14.342224 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ba8eebc6-93b5-43b4-b2b9-4916a6b76597 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:14.540327 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-ba8eebc6-93b5-43b4-b2b9-4916a6b76597 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:14.548733 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-ba8eebc6-93b5-43b4-b2b9-4916a6b76597 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1358 microversion: 2.1 time: 0.220683 Jun 03 10:08:14.558127 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 504/1024] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:14 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:15.565095 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-ffeac6ee-b154-4690-8b34-c99e96a14564 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:15.565738 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-ffeac6ee-b154-4690-8b34-c99e96a14564 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:15.573312 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ffeac6ee-b154-4690-8b34-c99e96a14564 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:15.573767 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ffeac6ee-b154-4690-8b34-c99e96a14564 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:15.574643 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ffeac6ee-b154-4690-8b34-c99e96a14564 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:15.575084 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ffeac6ee-b154-4690-8b34-c99e96a14564 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:15.716964 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-ffeac6ee-b154-4690-8b34-c99e96a14564 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:15.728727 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-ffeac6ee-b154-4690-8b34-c99e96a14564 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1358 microversion: 2.1 time: 0.167406 Jun 03 10:08:15.729278 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 521/1025] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:15 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:16.747667 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-d1aff7b4-b56b-4caa-aa81-91a0231dd00c tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:16.748493 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-d1aff7b4-b56b-4caa-aa81-91a0231dd00c tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:16.755464 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d1aff7b4-b56b-4caa-aa81-91a0231dd00c tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:16.755938 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d1aff7b4-b56b-4caa-aa81-91a0231dd00c tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:16.757242 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d1aff7b4-b56b-4caa-aa81-91a0231dd00c tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:16.757675 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d1aff7b4-b56b-4caa-aa81-91a0231dd00c tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:16.894498 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-d1aff7b4-b56b-4caa-aa81-91a0231dd00c tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:16.903437 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-d1aff7b4-b56b-4caa-aa81-91a0231dd00c tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1358 microversion: 2.1 time: 0.161046 Jun 03 10:08:16.904014 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 505/1026] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:16 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:17.921098 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-739a84b8-e6b8-4cdc-aa6a-004c502ebb9b tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:17.922046 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-739a84b8-e6b8-4cdc-aa6a-004c502ebb9b tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:17.929665 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-739a84b8-e6b8-4cdc-aa6a-004c502ebb9b tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:17.930243 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-739a84b8-e6b8-4cdc-aa6a-004c502ebb9b tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:17.931123 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-739a84b8-e6b8-4cdc-aa6a-004c502ebb9b tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:17.931637 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-739a84b8-e6b8-4cdc-aa6a-004c502ebb9b tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:18.071039 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-739a84b8-e6b8-4cdc-aa6a-004c502ebb9b tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:18.089178 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-739a84b8-e6b8-4cdc-aa6a-004c502ebb9b tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1358 microversion: 2.1 time: 0.172560 Jun 03 10:08:18.091289 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 522/1027] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:17 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:19.106990 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-4d5e55ca-311d-4bb5-a6a6-918674e5fd63 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:19.107774 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-4d5e55ca-311d-4bb5-a6a6-918674e5fd63 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:19.109990 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell0:SELECT=2 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:08:19.110843 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell0:SELECT=6 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:08:19.115878 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4d5e55ca-311d-4bb5-a6a6-918674e5fd63 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:19.116329 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4d5e55ca-311d-4bb5-a6a6-918674e5fd63 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:19.117109 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4d5e55ca-311d-4bb5-a6a6-918674e5fd63 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:19.117550 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4d5e55ca-311d-4bb5-a6a6-918674e5fd63 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:19.263343 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-4d5e55ca-311d-4bb5-a6a6-918674e5fd63 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:19.270833 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-4d5e55ca-311d-4bb5-a6a6-918674e5fd63 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1358 microversion: 2.1 time: 0.167727 Jun 03 10:08:19.271399 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 506/1028] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:19 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:20.202556 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-977cf3e9-7b4b-4c21-a9e8-c7c8a2760d70 req-03ba619e-f446-436d-8058-07eeb638781c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f97c1a06-6edf-4ccd-84b1-9f0cf52788f9", "tag": "9712d570-b0e3-4cae-821e-95248d924048"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:08:20.205974 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell0:SELECT=6 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:08:20.216006 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-977cf3e9-7b4b-4c21-a9e8-c7c8a2760d70 req-03ba619e-f446-436d-8058-07eeb638781c service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:20.216006 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-977cf3e9-7b4b-4c21-a9e8-c7c8a2760d70 req-03ba619e-f446-436d-8058-07eeb638781c service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:20.228798 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-977cf3e9-7b4b-4c21-a9e8-c7c8a2760d70 req-03ba619e-f446-436d-8058-07eeb638781c service nova] Creating event network-changed:9712d570-b0e3-4cae-821e-95248d924048 for instance f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 on hv-cinder-84456 Jun 03 10:08:20.235318 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-977cf3e9-7b4b-4c21-a9e8-c7c8a2760d70 req-03ba619e-f446-436d-8058-07eeb638781c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036606 Jun 03 10:08:20.236030 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 523/1029] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:08:20.292589 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-f2b943d2-9c16-40c7-ad27-82d0bbffa23d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:20.293392 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-f2b943d2-9c16-40c7-ad27-82d0bbffa23d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:20.301306 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f2b943d2-9c16-40c7-ad27-82d0bbffa23d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:20.301929 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f2b943d2-9c16-40c7-ad27-82d0bbffa23d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:20.302857 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f2b943d2-9c16-40c7-ad27-82d0bbffa23d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:20.303403 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f2b943d2-9c16-40c7-ad27-82d0bbffa23d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:20.508706 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-f2b943d2-9c16-40c7-ad27-82d0bbffa23d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:20.516203 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-f2b943d2-9c16-40c7-ad27-82d0bbffa23d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1358 microversion: 2.1 time: 0.232489 Jun 03 10:08:20.516776 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 507/1030] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:20 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:21.534554 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-ead6c761-b2d6-4558-8dac-8d78959d2aec tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:21.535284 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-ead6c761-b2d6-4558-8dac-8d78959d2aec tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:21.542568 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ead6c761-b2d6-4558-8dac-8d78959d2aec tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:21.543075 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ead6c761-b2d6-4558-8dac-8d78959d2aec tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:21.543804 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ead6c761-b2d6-4558-8dac-8d78959d2aec tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:21.544267 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-ead6c761-b2d6-4558-8dac-8d78959d2aec tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:21.676736 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-ead6c761-b2d6-4558-8dac-8d78959d2aec tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:21.684140 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-ead6c761-b2d6-4558-8dac-8d78959d2aec tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1358 microversion: 2.1 time: 0.154667 Jun 03 10:08:21.684699 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 524/1031] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:21 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:22.700377 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-96bba3c6-3628-49a0-87d3-9270a7ff204d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:22.701000 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-96bba3c6-3628-49a0-87d3-9270a7ff204d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:22.707443 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-96bba3c6-3628-49a0-87d3-9270a7ff204d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:22.707883 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-96bba3c6-3628-49a0-87d3-9270a7ff204d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:22.708646 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-96bba3c6-3628-49a0-87d3-9270a7ff204d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:22.709057 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-96bba3c6-3628-49a0-87d3-9270a7ff204d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:22.835507 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-96bba3c6-3628-49a0-87d3-9270a7ff204d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:22.842814 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-96bba3c6-3628-49a0-87d3-9270a7ff204d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1358 microversion: 2.1 time: 0.146278 Jun 03 10:08:22.843369 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 508/1032] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:22 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:23.860887 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-b2249779-f7eb-4802-b187-d120e9ac41a6 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:23.861538 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-b2249779-f7eb-4802-b187-d120e9ac41a6 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:23.868765 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b2249779-f7eb-4802-b187-d120e9ac41a6 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:23.869228 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b2249779-f7eb-4802-b187-d120e9ac41a6 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:23.870030 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b2249779-f7eb-4802-b187-d120e9ac41a6 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:23.870475 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-b2249779-f7eb-4802-b187-d120e9ac41a6 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:24.092356 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-b2249779-f7eb-4802-b187-d120e9ac41a6 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:24.100437 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-b2249779-f7eb-4802-b187-d120e9ac41a6 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1358 microversion: 2.1 time: 0.243808 Jun 03 10:08:24.101008 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 525/1033] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:23 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:25.116428 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-ff58fb1a-e077-4d51-a785-4a1406c187f2 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:25.117033 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-ff58fb1a-e077-4d51-a785-4a1406c187f2 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:25.123522 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ff58fb1a-e077-4d51-a785-4a1406c187f2 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:25.123958 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ff58fb1a-e077-4d51-a785-4a1406c187f2 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:25.124709 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ff58fb1a-e077-4d51-a785-4a1406c187f2 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:25.125142 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-ff58fb1a-e077-4d51-a785-4a1406c187f2 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:25.254129 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-ff58fb1a-e077-4d51-a785-4a1406c187f2 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:25.261918 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-ff58fb1a-e077-4d51-a785-4a1406c187f2 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1358 microversion: 2.1 time: 0.149318 Jun 03 10:08:25.262484 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 509/1034] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:25 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:25.825932 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-e20043c7-61a2-471c-a2ff-06569d0b6669 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:25.826470 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-e20043c7-61a2-471c-a2ff-06569d0b6669 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:25.832955 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e20043c7-61a2-471c-a2ff-06569d0b6669 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:25.835296 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e20043c7-61a2-471c-a2ff-06569d0b6669 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:25.835296 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e20043c7-61a2-471c-a2ff-06569d0b6669 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:25.835296 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e20043c7-61a2-471c-a2ff-06569d0b6669 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:25.858409 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-e20043c7-61a2-471c-a2ff-06569d0b6669 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286/ips" status: 200 len: 149 microversion: 2.1 time: 0.036359 Jun 03 10:08:25.861140 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 526/1035] 10.222.0.42 () {58 vars in 1247 bytes} [Fri Jun 3 10:08:25 2022] GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:08:25.957118 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-a3f21523-7672-44c6-8721-c962c02ad8b9 req-3dfa3528-b08b-471f-8048-22481f6ae9e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f97c1a06-6edf-4ccd-84b1-9f0cf52788f9", "name": "network-vif-plugged", "status": "completed", "tag": "9712d570-b0e3-4cae-821e-95248d924048"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:08:25.967335 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-a3f21523-7672-44c6-8721-c962c02ad8b9 req-3dfa3528-b08b-471f-8048-22481f6ae9e5 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:25.967747 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-a3f21523-7672-44c6-8721-c962c02ad8b9 req-3dfa3528-b08b-471f-8048-22481f6ae9e5 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:25.979536 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-a3f21523-7672-44c6-8721-c962c02ad8b9 req-3dfa3528-b08b-471f-8048-22481f6ae9e5 service nova] Creating event network-vif-plugged:9712d570-b0e3-4cae-821e-95248d924048 for instance f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 on hv-cinder-84456 Jun 03 10:08:25.984671 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-a3f21523-7672-44c6-8721-c962c02ad8b9 req-3dfa3528-b08b-471f-8048-22481f6ae9e5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031753 Jun 03 10:08:25.985306 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 510/1036] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:08:26.278284 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-eb8c66c9-c2b6-4ea2-98fd-bf50df033a14 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:26.278890 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-eb8c66c9-c2b6-4ea2-98fd-bf50df033a14 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:26.285378 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-eb8c66c9-c2b6-4ea2-98fd-bf50df033a14 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:26.285570 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-eb8c66c9-c2b6-4ea2-98fd-bf50df033a14 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:26.286237 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-eb8c66c9-c2b6-4ea2-98fd-bf50df033a14 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:26.286671 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-eb8c66c9-c2b6-4ea2-98fd-bf50df033a14 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:26.447324 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-eb8c66c9-c2b6-4ea2-98fd-bf50df033a14 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:26.454935 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-eb8c66c9-c2b6-4ea2-98fd-bf50df033a14 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1358 microversion: 2.1 time: 0.180707 Jun 03 10:08:26.455875 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 527/1037] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:26 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:27.472273 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-5690961b-9d65-4bbe-bf24-460ae0790927 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35c60da1-9a58-46da-941f-3e4f10144560"}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:08:27.472883 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-51b50a31-113b-4ad2-9f87-072170b2daf1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:27.473255 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-51b50a31-113b-4ad2-9f87-072170b2daf1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:27.473363 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-5690961b-9d65-4bbe-bf24-460ae0790927 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:27.480406 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5690961b-9d65-4bbe-bf24-460ae0790927 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:27.480591 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-51b50a31-113b-4ad2-9f87-072170b2daf1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:27.480867 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5690961b-9d65-4bbe-bf24-460ae0790927 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:27.480998 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-51b50a31-113b-4ad2-9f87-072170b2daf1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:27.481633 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5690961b-9d65-4bbe-bf24-460ae0790927 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:27.481754 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-51b50a31-113b-4ad2-9f87-072170b2daf1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:27.482131 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-51b50a31-113b-4ad2-9f87-072170b2daf1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:27.482245 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5690961b-9d65-4bbe-bf24-460ae0790927 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:27.611302 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-51b50a31-113b-4ad2-9f87-072170b2daf1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:27.618678 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-51b50a31-113b-4ad2-9f87-072170b2daf1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1358 microversion: 2.1 time: 0.150293 Jun 03 10:08:27.619237 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 511/1038] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:27 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:28.635186 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-8baf6d93-68a2-45dd-a1bf-ab06db4b5d74 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:28.635839 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-8baf6d93-68a2-45dd-a1bf-ab06db4b5d74 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:28.642271 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8baf6d93-68a2-45dd-a1bf-ab06db4b5d74 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:28.642725 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8baf6d93-68a2-45dd-a1bf-ab06db4b5d74 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:28.643487 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8baf6d93-68a2-45dd-a1bf-ab06db4b5d74 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:28.643956 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8baf6d93-68a2-45dd-a1bf-ab06db4b5d74 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:28.736881 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-5690961b-9d65-4bbe-bf24-460ae0790927 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "POST /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.268112 Jun 03 10:08:28.737794 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 528/1039] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jun 3 10:08:27 2022] POST /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286/os-volume_attachments => generated 194 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:08:28.776040 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-8baf6d93-68a2-45dd-a1bf-ab06db4b5d74 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:28.784281 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-8baf6d93-68a2-45dd-a1bf-ab06db4b5d74 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1547 microversion: 2.1 time: 0.152966 Jun 03 10:08:28.784856 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 512/1040] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:28 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:08:28.801195 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-7ffdb75a-4343-4ad7-a871-7c1e8b123e8a tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:28.801967 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-7ffdb75a-4343-4ad7-a871-7c1e8b123e8a tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:28.808964 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7ffdb75a-4343-4ad7-a871-7c1e8b123e8a tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:28.809447 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7ffdb75a-4343-4ad7-a871-7c1e8b123e8a tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:28.810254 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7ffdb75a-4343-4ad7-a871-7c1e8b123e8a tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:28.810697 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7ffdb75a-4343-4ad7-a871-7c1e8b123e8a tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:28.948965 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-7ffdb75a-4343-4ad7-a871-7c1e8b123e8a tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:28.957112 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-7ffdb75a-4343-4ad7-a871-7c1e8b123e8a tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1547 microversion: 2.1 time: 0.160123 Jun 03 10:08:28.957692 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 529/1041] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:28 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:08:28.972714 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-3b99049a-29f4-4410-93fd-d0b64478c490 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:28.976739 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-3b99049a-29f4-4410-93fd-d0b64478c490 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:28.977506 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-3b99049a-29f4-4410-93fd-d0b64478c490 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Searching by: {'deleted': False, 'project_id': 'bc1aca15157e45bf95284345dcabf101'} {{(pid=125066) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 03 10:08:28.984169 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3b99049a-29f4-4410-93fd-d0b64478c490 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:28.984615 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3b99049a-29f4-4410-93fd-d0b64478c490 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:28.985413 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3b99049a-29f4-4410-93fd-d0b64478c490 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:28.985852 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3b99049a-29f4-4410-93fd-d0b64478c490 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:29.075165 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.multi_cell_list [None req-3b99049a-29f4-4410-93fd-d0b64478c490 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125066) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 03 10:08:29.166740 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-3b99049a-29f4-4410-93fd-d0b64478c490 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.197848 Jun 03 10:08:29.167333 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 513/1042] 10.222.0.42 () {58 vars in 1124 bytes} [Fri Jun 3 10:08:28 2022] GET /compute/v2.1/servers => generated 343 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:08:29.177392 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-035b34e2-f6e5-4db5-b149-78888768face tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:29.178060 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-035b34e2-f6e5-4db5-b149-78888768face tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:29.184721 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-035b34e2-f6e5-4db5-b149-78888768face tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:29.185181 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-035b34e2-f6e5-4db5-b149-78888768face tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:29.186023 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-035b34e2-f6e5-4db5-b149-78888768face tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:29.186463 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-035b34e2-f6e5-4db5-b149-78888768face tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:29.316408 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-035b34e2-f6e5-4db5-b149-78888768face tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:29.324076 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-035b34e2-f6e5-4db5-b149-78888768face tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1547 microversion: 2.1 time: 0.150517 Jun 03 10:08:29.324731 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 530/1043] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:29 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:31.181324 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-46393e66-6672-4f16-a188-e29907a66b88 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2cec5a4-4d95-40ad-9cea-0d4eae210652"}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:08:31.182434 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-46393e66-6672-4f16-a188-e29907a66b88 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:31.189204 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-46393e66-6672-4f16-a188-e29907a66b88 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:31.189648 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-46393e66-6672-4f16-a188-e29907a66b88 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:31.190432 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-46393e66-6672-4f16-a188-e29907a66b88 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:31.190865 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-46393e66-6672-4f16-a188-e29907a66b88 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:31.868012 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-46393e66-6672-4f16-a188-e29907a66b88 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "POST /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.690408 Jun 03 10:08:31.868624 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 514/1044] 10.222.0.42 () {60 vars in 1322 bytes} [Fri Jun 3 10:08:31 2022] POST /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9/os-volume_attachments => generated 194 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:08:36.316716 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-9c6eaf1e-f546-4def-8926-31544e427eda tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:36.328558 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-9c6eaf1e-f546-4def-8926-31544e427eda tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:36.328558 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9c6eaf1e-f546-4def-8926-31544e427eda tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:36.328558 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9c6eaf1e-f546-4def-8926-31544e427eda tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:36.328558 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9c6eaf1e-f546-4def-8926-31544e427eda tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:36.328954 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9c6eaf1e-f546-4def-8926-31544e427eda tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:36.407435 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.objects.instance [None req-9c6eaf1e-f546-4def-8926-31544e427eda tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lazy-loading 'services' on Instance uuid efe3cd1b-2870-4ad9-8299-bf2eb727a286 {{(pid=125065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:08:36.593904 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-9c6eaf1e-f546-4def-8926-31544e427eda tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "DELETE /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286/os-volume_attachments/35c60da1-9a58-46da-941f-3e4f10144560" status: 202 len: 0 microversion: 2.1 time: 0.281020 Jun 03 10:08:36.594515 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 531/1045] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jun 3 10:08:36 2022] DELETE /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286/os-volume_attachments/35c60da1-9a58-46da-941f-3e4f10144560 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:08:36.603929 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-b04a49b3-4993-4acb-9866-4abae1ee72ff tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:36.605030 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-b04a49b3-4993-4acb-9866-4abae1ee72ff tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:36.611509 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b04a49b3-4993-4acb-9866-4abae1ee72ff tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:36.611952 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b04a49b3-4993-4acb-9866-4abae1ee72ff tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:36.612700 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b04a49b3-4993-4acb-9866-4abae1ee72ff tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:36.613129 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b04a49b3-4993-4acb-9866-4abae1ee72ff tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:36.642709 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-b04a49b3-4993-4acb-9866-4abae1ee72ff tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043632 Jun 03 10:08:36.643259 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 515/1046] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 3 10:08:36 2022] GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:08:37.655551 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-dfdb5c0e-4e41-44ff-bd97-3eae54c3e909 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:37.656624 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-dfdb5c0e-4e41-44ff-bd97-3eae54c3e909 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:37.663140 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-dfdb5c0e-4e41-44ff-bd97-3eae54c3e909 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:37.663592 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-dfdb5c0e-4e41-44ff-bd97-3eae54c3e909 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:37.664352 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-dfdb5c0e-4e41-44ff-bd97-3eae54c3e909 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:37.664809 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-dfdb5c0e-4e41-44ff-bd97-3eae54c3e909 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:37.693016 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-dfdb5c0e-4e41-44ff-bd97-3eae54c3e909 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042326 Jun 03 10:08:37.693557 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 532/1047] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 3 10:08:37 2022] GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:08:38.705167 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-e2a89b0c-9e8c-475d-bc08-e00875b2fa6f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:38.706044 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-e2a89b0c-9e8c-475d-bc08-e00875b2fa6f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:38.708499 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:08:38.713811 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e2a89b0c-9e8c-475d-bc08-e00875b2fa6f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:38.714367 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e2a89b0c-9e8c-475d-bc08-e00875b2fa6f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:38.715168 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e2a89b0c-9e8c-475d-bc08-e00875b2fa6f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:38.715615 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e2a89b0c-9e8c-475d-bc08-e00875b2fa6f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:38.718148 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:08:38.745835 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-e2a89b0c-9e8c-475d-bc08-e00875b2fa6f tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044667 Jun 03 10:08:38.746438 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 516/1048] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 3 10:08:38 2022] GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:08:39.758105 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-9aebb658-4d0b-49bb-80a8-00e4c9347178 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:39.759066 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-9aebb658-4d0b-49bb-80a8-00e4c9347178 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:39.765687 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9aebb658-4d0b-49bb-80a8-00e4c9347178 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:39.766172 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9aebb658-4d0b-49bb-80a8-00e4c9347178 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:39.766931 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9aebb658-4d0b-49bb-80a8-00e4c9347178 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:39.767367 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9aebb658-4d0b-49bb-80a8-00e4c9347178 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:39.796056 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-9aebb658-4d0b-49bb-80a8-00e4c9347178 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042877 Jun 03 10:08:39.796606 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 533/1049] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 3 10:08:39 2022] GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:08:40.808010 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-6af17edd-688a-442e-9f4f-5fad55a295ae tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:40.808931 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-6af17edd-688a-442e-9f4f-5fad55a295ae tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:40.811083 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell0:SELECT=2 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:08:40.817155 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6af17edd-688a-442e-9f4f-5fad55a295ae tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:40.817606 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6af17edd-688a-442e-9f4f-5fad55a295ae tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:40.818392 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6af17edd-688a-442e-9f4f-5fad55a295ae tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:40.818833 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-6af17edd-688a-442e-9f4f-5fad55a295ae tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:40.847112 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-6af17edd-688a-442e-9f4f-5fad55a295ae tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044062 Jun 03 10:08:40.847666 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 517/1050] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 3 10:08:40 2022] GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:08:41.858591 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-e70e1645-f622-4850-b562-c42f8556a605 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:41.870478 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-e70e1645-f622-4850-b562-c42f8556a605 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:41.870478 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:08:41.870478 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e70e1645-f622-4850-b562-c42f8556a605 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:41.870478 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e70e1645-f622-4850-b562-c42f8556a605 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:41.870881 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e70e1645-f622-4850-b562-c42f8556a605 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:41.870881 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-e70e1645-f622-4850-b562-c42f8556a605 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:41.871461 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:08:41.899455 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-e70e1645-f622-4850-b562-c42f8556a605 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044792 Jun 03 10:08:41.900036 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 534/1051] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 3 10:08:41 2022] GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:08:42.912192 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-7d6ed4f8-5576-498c-9def-fb46747d8dac tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:42.913669 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-7d6ed4f8-5576-498c-9def-fb46747d8dac tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:42.921277 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7d6ed4f8-5576-498c-9def-fb46747d8dac tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:42.921712 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7d6ed4f8-5576-498c-9def-fb46747d8dac tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:42.930008 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7d6ed4f8-5576-498c-9def-fb46747d8dac tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:42.930008 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-7d6ed4f8-5576-498c-9def-fb46747d8dac tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:42.953002 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-7d6ed4f8-5576-498c-9def-fb46747d8dac tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045734 Jun 03 10:08:42.958960 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 518/1052] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 3 10:08:42 2022] GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:08:43.605587 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-155046f1-e303-401b-bad3-631e15837562 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:43.606239 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-155046f1-e303-401b-bad3-631e15837562 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:43.614232 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-155046f1-e303-401b-bad3-631e15837562 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:43.614680 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-155046f1-e303-401b-bad3-631e15837562 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:43.615497 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-155046f1-e303-401b-bad3-631e15837562 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:43.615968 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-155046f1-e303-401b-bad3-631e15837562 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:43.746529 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-155046f1-e303-401b-bad3-631e15837562 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:43.754627 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-155046f1-e303-401b-bad3-631e15837562 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1593 microversion: 2.1 time: 0.152849 Jun 03 10:08:43.757256 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 535/1053] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:43 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1593 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:43.965669 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-aadc0046-df36-4daa-8872-36d923cab1ed tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:43.966548 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-aadc0046-df36-4daa-8872-36d923cab1ed tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:43.973489 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-aadc0046-df36-4daa-8872-36d923cab1ed tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:43.973968 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-aadc0046-df36-4daa-8872-36d923cab1ed tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:43.974776 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-aadc0046-df36-4daa-8872-36d923cab1ed tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:43.975905 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-aadc0046-df36-4daa-8872-36d923cab1ed tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:44.005295 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-aadc0046-df36-4daa-8872-36d923cab1ed tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044079 Jun 03 10:08:44.005895 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 519/1054] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 3 10:08:43 2022] GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 03 10:08:44.064320 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-adf2f85c-50e4-4f36-8548-9c25bba47be8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:44.064900 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-adf2f85c-50e4-4f36-8548-9c25bba47be8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:44.072259 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-adf2f85c-50e4-4f36-8548-9c25bba47be8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:44.082205 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-adf2f85c-50e4-4f36-8548-9c25bba47be8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:44.082205 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-adf2f85c-50e4-4f36-8548-9c25bba47be8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:44.082205 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-adf2f85c-50e4-4f36-8548-9c25bba47be8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:44.099829 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-adf2f85c-50e4-4f36-8548-9c25bba47be8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] Going to try to terminate instance {{(pid=125065) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:08:44.457976 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-adf2f85c-50e4-4f36-8548-9c25bba47be8 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "DELETE /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286" status: 204 len: 0 microversion: 2.1 time: 0.397339 Jun 03 10:08:44.458576 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 536/1055] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 3 10:08:44 2022] DELETE /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:08:44.467198 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-3e8263db-6da1-4ff5-a6a8-b1fe9f2c62bb tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:44.470148 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-3e8263db-6da1-4ff5-a6a8-b1fe9f2c62bb tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:44.474239 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3e8263db-6da1-4ff5-a6a8-b1fe9f2c62bb tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:44.474693 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3e8263db-6da1-4ff5-a6a8-b1fe9f2c62bb tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:44.475480 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3e8263db-6da1-4ff5-a6a8-b1fe9f2c62bb tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:44.475953 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-3e8263db-6da1-4ff5-a6a8-b1fe9f2c62bb tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:44.693531 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-3e8263db-6da1-4ff5-a6a8-b1fe9f2c62bb tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:44.701239 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-3e8263db-6da1-4ff5-a6a8-b1fe9f2c62bb tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286" status: 200 len: 1678 microversion: 2.1 time: 0.237866 Jun 03 10:08:44.701814 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 520/1056] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:44 2022] GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286 => generated 1678 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:45.719813 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-27e4f7db-80c9-4a0e-b941-8a8f2ef0f8f3 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:45.720610 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-27e4f7db-80c9-4a0e-b941-8a8f2ef0f8f3 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:45.728025 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-27e4f7db-80c9-4a0e-b941-8a8f2ef0f8f3 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:45.728482 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-27e4f7db-80c9-4a0e-b941-8a8f2ef0f8f3 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:45.729293 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-27e4f7db-80c9-4a0e-b941-8a8f2ef0f8f3 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:45.729776 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-27e4f7db-80c9-4a0e-b941-8a8f2ef0f8f3 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:45.891407 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-27e4f7db-80c9-4a0e-b941-8a8f2ef0f8f3 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:45.899494 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-27e4f7db-80c9-4a0e-b941-8a8f2ef0f8f3 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286" status: 200 len: 1678 microversion: 2.1 time: 0.184175 Jun 03 10:08:45.900060 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 537/1057] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:45 2022] GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286 => generated 1678 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:46.279200 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-1f282228-3bb7-41b0-b34e-5201ed6cf64a req-299c9bf0-e34f-4e44-8bd9-12c2286df650 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f97c1a06-6edf-4ccd-84b1-9f0cf52788f9", "tag": "9712d570-b0e3-4cae-821e-95248d924048"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:08:46.289764 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-1f282228-3bb7-41b0-b34e-5201ed6cf64a req-299c9bf0-e34f-4e44-8bd9-12c2286df650 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:46.290610 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-1f282228-3bb7-41b0-b34e-5201ed6cf64a req-299c9bf0-e34f-4e44-8bd9-12c2286df650 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:46.302653 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-1f282228-3bb7-41b0-b34e-5201ed6cf64a req-299c9bf0-e34f-4e44-8bd9-12c2286df650 service nova] Creating event network-changed:9712d570-b0e3-4cae-821e-95248d924048 for instance f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 on hv-cinder-84456 Jun 03 10:08:46.308281 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-1f282228-3bb7-41b0-b34e-5201ed6cf64a req-299c9bf0-e34f-4e44-8bd9-12c2286df650 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106884 Jun 03 10:08:46.309555 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 521/1058] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:08:46.916747 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-bb5814d7-0d16-41bf-8adf-b4f1c4d24780 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:46.918262 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-bb5814d7-0d16-41bf-8adf-b4f1c4d24780 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:46.925973 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-bb5814d7-0d16-41bf-8adf-b4f1c4d24780 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:46.926431 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-bb5814d7-0d16-41bf-8adf-b4f1c4d24780 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:46.927759 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-bb5814d7-0d16-41bf-8adf-b4f1c4d24780 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:46.928402 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-bb5814d7-0d16-41bf-8adf-b4f1c4d24780 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:47.073033 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-bb5814d7-0d16-41bf-8adf-b4f1c4d24780 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:47.083597 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-bb5814d7-0d16-41bf-8adf-b4f1c4d24780 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286" status: 200 len: 1611 microversion: 2.1 time: 0.170780 Jun 03 10:08:47.090625 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 538/1059] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:46 2022] GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286 => generated 1611 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:48.209059 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-30cded2c-5edf-44e6-b7c0-cb81a7e96cd9 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:48.210577 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-30cded2c-5edf-44e6-b7c0-cb81a7e96cd9 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:48.218520 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-30cded2c-5edf-44e6-b7c0-cb81a7e96cd9 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:48.218965 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-30cded2c-5edf-44e6-b7c0-cb81a7e96cd9 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:48.219866 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-30cded2c-5edf-44e6-b7c0-cb81a7e96cd9 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:48.220331 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-30cded2c-5edf-44e6-b7c0-cb81a7e96cd9 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:48.253150 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-30cded2c-5edf-44e6-b7c0-cb81a7e96cd9 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:48.253600 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-30cded2c-5edf-44e6-b7c0-cb81a7e96cd9 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:48.254336 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.objects.instance [None req-30cded2c-5edf-44e6-b7c0-cb81a7e96cd9 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lazy-loading 'fault' on Instance uuid efe3cd1b-2870-4ad9-8299-bf2eb727a286 {{(pid=125066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:08:48.304752 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-30cded2c-5edf-44e6-b7c0-cb81a7e96cd9 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce77221a2c8d4c4395bed092c1967b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e51010dd5d84daf8aa43859e9e7cb6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:48.311903 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-30cded2c-5edf-44e6-b7c0-cb81a7e96cd9 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286" status: 200 len: 1329 microversion: 2.1 time: 0.214929 Jun 03 10:08:48.312574 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 522/1060] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:48 2022] GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286 => generated 1329 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:48.326118 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-726e0d17-df38-459f-878b-0d0e68929350 req-f63d5a1b-f860-46f5-9554-c53f2928f402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efe3cd1b-2870-4ad9-8299-bf2eb727a286", "name": "network-vif-deleted", "tag": "c1c2c52c-81ea-4785-aff0-e8e7fa7ed389"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:08:48.336861 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-726e0d17-df38-459f-878b-0d0e68929350 req-f63d5a1b-f860-46f5-9554-c53f2928f402 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:48.338364 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-726e0d17-df38-459f-878b-0d0e68929350 req-f63d5a1b-f860-46f5-9554-c53f2928f402 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:48.350510 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-726e0d17-df38-459f-878b-0d0e68929350 req-f63d5a1b-f860-46f5-9554-c53f2928f402 service nova] Creating event network-vif-deleted:c1c2c52c-81ea-4785-aff0-e8e7fa7ed389 for instance efe3cd1b-2870-4ad9-8299-bf2eb727a286 on hv-cinder-84456 Jun 03 10:08:48.356684 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-726e0d17-df38-459f-878b-0d0e68929350 req-f63d5a1b-f860-46f5-9554-c53f2928f402 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034740 Jun 03 10:08:48.358244 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 539/1061] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:08:48.805356 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-a83e1292-cbae-4361-849a-ad5c727e9156 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1951292509"}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:08:48.805906 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-a83e1292-cbae-4361-849a-ad5c727e9156 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:48.811946 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a83e1292-cbae-4361-849a-ad5c727e9156 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:48.812402 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a83e1292-cbae-4361-849a-ad5c727e9156 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:48.813162 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a83e1292-cbae-4361-849a-ad5c727e9156 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:48.813603 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-a83e1292-cbae-4361-849a-ad5c727e9156 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:48.938751 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.network.security_group_api [None req-a83e1292-cbae-4361-849a-ad5c727e9156 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Adding security group cef61ad8-b587-47c5-8346-035aa684925d to port 9712d570-b0e3-4cae-821e-95248d924048 Jun 03 10:08:49.331765 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-faa816df-096c-413d-afdd-8d08455525cf tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:49.331765 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-faa816df-096c-413d-afdd-8d08455525cf tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:49.338610 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-faa816df-096c-413d-afdd-8d08455525cf tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:49.339163 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-faa816df-096c-413d-afdd-8d08455525cf tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:49.340025 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-faa816df-096c-413d-afdd-8d08455525cf tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:49.340704 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-faa816df-096c-413d-afdd-8d08455525cf tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:49.357446 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.wsgi [None req-faa816df-096c-413d-afdd-8d08455525cf tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] HTTP exception thrown: Instance efe3cd1b-2870-4ad9-8299-bf2eb727a286 could not be found. Jun 03 10:08:49.359612 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-faa816df-096c-413d-afdd-8d08455525cf tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Request method failure captured: Jun 03 10:08:49.359612 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: request: GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286 HTTP/1.1 Jun 03 10:08:49.359612 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept: application/json Jun 03 10:08:49.359612 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept-Encoding: identity Jun 03 10:08:49.359612 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Connection: close Jun 03 10:08:49.359612 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Length: 0 Jun 03 10:08:49.359612 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Type: application/json Jun 03 10:08:49.359612 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Host: 10.222.0.42 Jun 03 10:08:49.359612 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Openstack-System-Scope: None Jun 03 10:08:49.359612 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: User-Agent: python-urllib3/1.26.9 Jun 03 10:08:49.359612 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Auth-Token: gAAAAABimdyERpWAQe95aVogk3CBzbbvoVqsT1mcXcyeAA1KIeWqlrXYLL74Vx2g9GU9bQbymV8F-OiCfQLZd3XmBfURzXWp91tRpkL6WEAH_Q17Tl2wrUlWolA1gi8vDdxsnFf79KdskWgeoWa8fRazmnte5HviUSJ7Rm7SGX5FgU84B4GApr0 Jun 03 10:08:49.359612 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Id: None Jun 03 10:08:49.359612 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Name: None Jun 03 10:08:49.359612 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Identity-Status: Confirmed Jun 03 10:08:49.359612 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Is-Admin-Project: True Jun 03 10:08:49.359612 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Id: default Jun 03 10:08:49.359612 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Name: Default Jun 03 10:08:49.359612 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Id: 3e51010dd5d84daf8aa43859e9e7cb6d Jun 03 10:08:49.359612 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Name: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:08:49.359612 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Role: member,reader Jun 03 10:08:49.359612 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Roles: member,reader Jun 03 10:08:49.368483 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3e51010dd5d84daf8aa43859e9e7cb6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e51010dd5d84daf8aa43859e9e7cb6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3e51010dd5d84daf8aa43859e9e7cb6d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e51010dd5d84daf8aa43859e9e7cb6d"}]}] Jun 03 10:08:49.368483 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:08:49.368483 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Id: 3e51010dd5d84daf8aa43859e9e7cb6d Jun 03 10:08:49.368483 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:08:49.368483 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User: tempest-AttachVolumeNegativeTest-1165735283-project Jun 03 10:08:49.368483 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Id: default Jun 03 10:08:49.368483 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Name: Default Jun 03 10:08:49.368483 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Id: ce77221a2c8d4c4395bed092c1967b28 Jun 03 10:08:49.368483 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Name: tempest-AttachVolumeNegativeTest-1165735283-project Jun 03 10:08:49.368483 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: method: > Jun 03 10:08:49.368483 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: exception: Instance efe3cd1b-2870-4ad9-8299-bf2eb727a286 could not be found. Jun 03 10:08:49.368483 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: action_args: {'id': 'efe3cd1b-2870-4ad9-8299-bf2eb727a286'} Jun 03 10:08:49.369589 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:08:49.369589 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:49.369589 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:08:49.369589 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:08:49.369589 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:08:49.369589 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:08:49.369589 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:08:49.369589 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:08:49.369589 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:08:49.369589 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:08:49.369589 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efe3cd1b-2870-4ad9-8299-bf2eb727a286 could not be found. Jun 03 10:08:49.369589 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:08:49.369589 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:08:49.369589 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:08:49.369589 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:49.369589 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:08:49.369589 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:08:49.369589 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:08:49.369589 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:08:49.369589 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:08:49.371240 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:08:49.371240 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:08:49.371240 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:08:49.371240 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:08:49.371240 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:08:49.371240 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:08:49.371240 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:08:49.371240 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efe3cd1b-2870-4ad9-8299-bf2eb727a286 could not be found. Jun 03 10:08:49.371240 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:08:49.371240 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:08:49.371240 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:08:49.371240 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:49.371240 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:08:49.371240 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:08:49.371240 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:08:49.371240 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:08:49.371240 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efe3cd1b-2870-4ad9-8299-bf2eb727a286 could not be found. Jun 03 10:08:49.371240 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:08:49.372553 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-faa816df-096c-413d-afdd-8d08455525cf tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Returning 404 to user: Instance efe3cd1b-2870-4ad9-8299-bf2eb727a286 could not be found. {{(pid=125065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:08:49.372553 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-faa816df-096c-413d-afdd-8d08455525cf tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286" status: 404 len: 111 microversion: 2.1 time: 0.035293 Jun 03 10:08:49.372747 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-a83e1292-cbae-4361-849a-ad5c727e9156 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "POST /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9/action" status: 202 len: 0 microversion: 2.1 time: 0.561707 Jun 03 10:08:49.373192 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 540/1062] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:49 2022] GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:08:49.373288 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 523/1063] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jun 3 10:08:48 2022] POST /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9/action => generated 0 bytes in 564 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:08:49.376799 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-60a3f111-2a99-4855-857a-53f115bbf55b tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:49.377309 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-a1128890-3939-4068-b6fc-77039d4713cf tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '.version_select at 0x7f8d3516c550>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:49.377978 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-60a3f111-2a99-4855-857a-53f115bbf55b tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:49.385503 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-60a3f111-2a99-4855-857a-53f115bbf55b tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:49.386335 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-60a3f111-2a99-4855-857a-53f115bbf55b tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:49.387578 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-60a3f111-2a99-4855-857a-53f115bbf55b tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:49.388222 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-60a3f111-2a99-4855-857a-53f115bbf55b tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:49.481621 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-a1128890-3939-4068-b6fc-77039d4713cf tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-72091146" status: 202 len: 0 microversion: 2.1 time: 0.111993 Jun 03 10:08:49.485295 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 541/1064] 10.222.0.42 () {58 vars in 1214 bytes} [Fri Jun 3 10:08:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-72091146 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:08:49.575039 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-60a3f111-2a99-4855-857a-53f115bbf55b tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:49.586877 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-60a3f111-2a99-4855-857a-53f115bbf55b tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1758 microversion: 2.1 time: 0.217047 Jun 03 10:08:49.600155 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 524/1065] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:49 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1758 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:50.387977 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-89dfc7b7-732a-45aa-99e7-06a9c0a87f52 req-660a8a2d-5414-457a-93ad-80612fa5361f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f97c1a06-6edf-4ccd-84b1-9f0cf52788f9", "tag": "9712d570-b0e3-4cae-821e-95248d924048"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:08:50.398430 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-89dfc7b7-732a-45aa-99e7-06a9c0a87f52 req-660a8a2d-5414-457a-93ad-80612fa5361f service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:50.398874 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-89dfc7b7-732a-45aa-99e7-06a9c0a87f52 req-660a8a2d-5414-457a-93ad-80612fa5361f service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:50.409858 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-89dfc7b7-732a-45aa-99e7-06a9c0a87f52 req-660a8a2d-5414-457a-93ad-80612fa5361f service nova] Creating event network-changed:9712d570-b0e3-4cae-821e-95248d924048 for instance f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 on hv-cinder-84456 Jun 03 10:08:50.415691 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-89dfc7b7-732a-45aa-99e7-06a9c0a87f52 req-660a8a2d-5414-457a-93ad-80612fa5361f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033469 Jun 03 10:08:50.416278 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 542/1066] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:08:50.997961 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-30add9d1-215e-40ca-9b1d-38aebb7fa4f4 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:51.004347 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-30add9d1-215e-40ca-9b1d-38aebb7fa4f4 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: ba348d8e-b108-46ae-8ef2-db977c9ca0d6] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:51.004484 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-0370912b-1557-4160-8708-5c5ff590c7ae req-0a407211-339e-4643-8aff-9bfdd7967f57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba348d8e-b108-46ae-8ef2-db977c9ca0d6", "tag": "ddeb8364-fea9-49e6-8361-912b3e7116bb"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:08:51.005689 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-30add9d1-215e-40ca-9b1d-38aebb7fa4f4 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:51.006191 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-30add9d1-215e-40ca-9b1d-38aebb7fa4f4 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:51.007082 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-30add9d1-215e-40ca-9b1d-38aebb7fa4f4 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:51.007515 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-30add9d1-215e-40ca-9b1d-38aebb7fa4f4 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:51.011197 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-0370912b-1557-4160-8708-5c5ff590c7ae req-0a407211-339e-4643-8aff-9bfdd7967f57 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:51.011648 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-0370912b-1557-4160-8708-5c5ff590c7ae req-0a407211-339e-4643-8aff-9bfdd7967f57 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:51.023528 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-0370912b-1557-4160-8708-5c5ff590c7ae req-0a407211-339e-4643-8aff-9bfdd7967f57 service nova] Creating event network-changed:ddeb8364-fea9-49e6-8361-912b3e7116bb for instance ba348d8e-b108-46ae-8ef2-db977c9ca0d6 on hv-cinder-84456 Jun 03 10:08:51.028854 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-0370912b-1557-4160-8708-5c5ff590c7ae req-0a407211-339e-4643-8aff-9bfdd7967f57 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031715 Jun 03 10:08:51.032796 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 543/1067] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:08:51.034048 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-30add9d1-215e-40ca-9b1d-38aebb7fa4f4 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: ba348d8e-b108-46ae-8ef2-db977c9ca0d6] Going to try to terminate instance {{(pid=125066) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:08:51.360457 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-30add9d1-215e-40ca-9b1d-38aebb7fa4f4 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6" status: 204 len: 0 microversion: 2.1 time: 0.366151 Jun 03 10:08:51.361104 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 525/1068] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 3 10:08:50 2022] DELETE /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:08:51.370365 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-677d86fc-4897-4b54-a897-033e82493a8e tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:51.373414 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-677d86fc-4897-4b54-a897-033e82493a8e tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: ba348d8e-b108-46ae-8ef2-db977c9ca0d6] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:51.377556 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-677d86fc-4897-4b54-a897-033e82493a8e tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:51.378055 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-677d86fc-4897-4b54-a897-033e82493a8e tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:51.379141 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-677d86fc-4897-4b54-a897-033e82493a8e tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:51.379625 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-677d86fc-4897-4b54-a897-033e82493a8e tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:51.511669 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-677d86fc-4897-4b54-a897-033e82493a8e tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:51.519523 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-677d86fc-4897-4b54-a897-033e82493a8e tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6" status: 200 len: 1578 microversion: 2.1 time: 0.153901 Jun 03 10:08:51.520091 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 544/1069] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:51 2022] GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6 => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:08:51.704721 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-915a8a7f-30ca-4eff-ab92-4607630b6c76 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:51.705373 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-915a8a7f-30ca-4eff-ab92-4607630b6c76 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:51.711628 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-915a8a7f-30ca-4eff-ab92-4607630b6c76 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:51.712152 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-915a8a7f-30ca-4eff-ab92-4607630b6c76 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:51.712992 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-915a8a7f-30ca-4eff-ab92-4607630b6c76 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:51.713527 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-915a8a7f-30ca-4eff-ab92-4607630b6c76 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:51.728063 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.wsgi [None req-915a8a7f-30ca-4eff-ab92-4607630b6c76 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] HTTP exception thrown: Instance efe3cd1b-2870-4ad9-8299-bf2eb727a286 could not be found. Jun 03 10:08:51.729778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-915a8a7f-30ca-4eff-ab92-4607630b6c76 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Request method failure captured: Jun 03 10:08:51.729778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: request: DELETE /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286 HTTP/1.1 Jun 03 10:08:51.729778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept: application/json Jun 03 10:08:51.729778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept-Encoding: identity Jun 03 10:08:51.729778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Connection: close Jun 03 10:08:51.729778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Length: 0 Jun 03 10:08:51.729778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Type: application/json Jun 03 10:08:51.729778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Host: 10.222.0.42 Jun 03 10:08:51.729778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Openstack-System-Scope: None Jun 03 10:08:51.729778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: User-Agent: python-urllib3/1.26.9 Jun 03 10:08:51.729778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Auth-Token: gAAAAABimdyERpWAQe95aVogk3CBzbbvoVqsT1mcXcyeAA1KIeWqlrXYLL74Vx2g9GU9bQbymV8F-OiCfQLZd3XmBfURzXWp91tRpkL6WEAH_Q17Tl2wrUlWolA1gi8vDdxsnFf79KdskWgeoWa8fRazmnte5HviUSJ7Rm7SGX5FgU84B4GApr0 Jun 03 10:08:51.729778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Id: None Jun 03 10:08:51.729778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Name: None Jun 03 10:08:51.729778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Identity-Status: Confirmed Jun 03 10:08:51.729778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Is-Admin-Project: True Jun 03 10:08:51.729778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Id: default Jun 03 10:08:51.729778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Name: Default Jun 03 10:08:51.729778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Id: 3e51010dd5d84daf8aa43859e9e7cb6d Jun 03 10:08:51.729778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Name: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:08:51.729778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Role: member,reader Jun 03 10:08:51.729778 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Roles: member,reader Jun 03 10:08:51.731484 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3e51010dd5d84daf8aa43859e9e7cb6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e51010dd5d84daf8aa43859e9e7cb6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3e51010dd5d84daf8aa43859e9e7cb6d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e51010dd5d84daf8aa43859e9e7cb6d"}]}] Jun 03 10:08:51.731484 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:08:51.731484 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Id: 3e51010dd5d84daf8aa43859e9e7cb6d Jun 03 10:08:51.731484 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:08:51.731484 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User: tempest-AttachVolumeNegativeTest-1165735283-project Jun 03 10:08:51.731484 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Id: default Jun 03 10:08:51.731484 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Name: Default Jun 03 10:08:51.731484 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Id: ce77221a2c8d4c4395bed092c1967b28 Jun 03 10:08:51.731484 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Name: tempest-AttachVolumeNegativeTest-1165735283-project Jun 03 10:08:51.731484 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: method: > Jun 03 10:08:51.731484 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: exception: Instance efe3cd1b-2870-4ad9-8299-bf2eb727a286 could not be found. Jun 03 10:08:51.731484 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: action_args: {'id': 'efe3cd1b-2870-4ad9-8299-bf2eb727a286'} Jun 03 10:08:51.732644 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:08:51.732644 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:51.732644 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:08:51.732644 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:08:51.732644 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:08:51.732644 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:08:51.732644 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:08:51.732644 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:08:51.732644 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:08:51.732644 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:08:51.732644 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efe3cd1b-2870-4ad9-8299-bf2eb727a286 could not be found. Jun 03 10:08:51.732644 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:08:51.732644 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:08:51.732644 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:08:51.732644 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:51.732644 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:08:51.732644 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:08:51.732644 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:08:51.732644 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:08:51.732644 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:08:51.737376 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:08:51.737376 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 10:08:51.737376 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 10:08:51.737376 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 10:08:51.737376 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 10:08:51.737376 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:08:51.737376 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:08:51.737376 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:08:51.737376 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:08:51.737376 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efe3cd1b-2870-4ad9-8299-bf2eb727a286 could not be found. Jun 03 10:08:51.737376 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:08:51.737376 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:08:51.737376 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:08:51.737376 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:51.737376 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:08:51.737376 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:08:51.737376 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:08:51.737376 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:08:51.737376 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efe3cd1b-2870-4ad9-8299-bf2eb727a286 could not be found. Jun 03 10:08:51.737376 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:08:51.738971 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-915a8a7f-30ca-4eff-ab92-4607630b6c76 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Returning 404 to user: Instance efe3cd1b-2870-4ad9-8299-bf2eb727a286 could not be found. {{(pid=125066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:08:51.738971 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-915a8a7f-30ca-4eff-ab92-4607630b6c76 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "DELETE /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286" status: 404 len: 111 microversion: 2.1 time: 0.031899 Jun 03 10:08:51.738971 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 526/1070] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 3 10:08:51 2022] DELETE /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 10:08:51.742428 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-949c1c12-1f6b-44f0-b1d7-09eb3f5a472e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:51.743044 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-949c1c12-1f6b-44f0-b1d7-09eb3f5a472e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: efe3cd1b-2870-4ad9-8299-bf2eb727a286] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:51.749037 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-949c1c12-1f6b-44f0-b1d7-09eb3f5a472e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:51.749496 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-949c1c12-1f6b-44f0-b1d7-09eb3f5a472e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:51.750282 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-949c1c12-1f6b-44f0-b1d7-09eb3f5a472e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:51.750718 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-949c1c12-1f6b-44f0-b1d7-09eb3f5a472e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:51.764757 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.wsgi [None req-949c1c12-1f6b-44f0-b1d7-09eb3f5a472e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] HTTP exception thrown: Instance efe3cd1b-2870-4ad9-8299-bf2eb727a286 could not be found. Jun 03 10:08:51.766450 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-949c1c12-1f6b-44f0-b1d7-09eb3f5a472e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Request method failure captured: Jun 03 10:08:51.766450 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: request: GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286 HTTP/1.1 Jun 03 10:08:51.766450 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept: application/json Jun 03 10:08:51.766450 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept-Encoding: identity Jun 03 10:08:51.766450 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Connection: close Jun 03 10:08:51.766450 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Length: 0 Jun 03 10:08:51.766450 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Type: application/json Jun 03 10:08:51.766450 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Host: 10.222.0.42 Jun 03 10:08:51.766450 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Openstack-System-Scope: None Jun 03 10:08:51.766450 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: User-Agent: python-urllib3/1.26.9 Jun 03 10:08:51.766450 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Auth-Token: gAAAAABimdyERpWAQe95aVogk3CBzbbvoVqsT1mcXcyeAA1KIeWqlrXYLL74Vx2g9GU9bQbymV8F-OiCfQLZd3XmBfURzXWp91tRpkL6WEAH_Q17Tl2wrUlWolA1gi8vDdxsnFf79KdskWgeoWa8fRazmnte5HviUSJ7Rm7SGX5FgU84B4GApr0 Jun 03 10:08:51.766450 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Id: None Jun 03 10:08:51.766450 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Name: None Jun 03 10:08:51.766450 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Identity-Status: Confirmed Jun 03 10:08:51.766450 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Is-Admin-Project: True Jun 03 10:08:51.766450 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Id: default Jun 03 10:08:51.766450 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Name: Default Jun 03 10:08:51.766450 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Id: 3e51010dd5d84daf8aa43859e9e7cb6d Jun 03 10:08:51.766450 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Name: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:08:51.766450 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Role: member,reader Jun 03 10:08:51.766450 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Roles: member,reader Jun 03 10:08:51.768071 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3e51010dd5d84daf8aa43859e9e7cb6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e51010dd5d84daf8aa43859e9e7cb6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3e51010dd5d84daf8aa43859e9e7cb6d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e51010dd5d84daf8aa43859e9e7cb6d"}]}] Jun 03 10:08:51.768071 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:08:51.768071 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Id: 3e51010dd5d84daf8aa43859e9e7cb6d Jun 03 10:08:51.768071 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:08:51.768071 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User: tempest-AttachVolumeNegativeTest-1165735283-project Jun 03 10:08:51.768071 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Id: default Jun 03 10:08:51.768071 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Name: Default Jun 03 10:08:51.768071 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Id: ce77221a2c8d4c4395bed092c1967b28 Jun 03 10:08:51.768071 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Name: tempest-AttachVolumeNegativeTest-1165735283-project Jun 03 10:08:51.768071 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: method: > Jun 03 10:08:51.768071 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: exception: Instance efe3cd1b-2870-4ad9-8299-bf2eb727a286 could not be found. Jun 03 10:08:51.768071 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: action_args: {'id': 'efe3cd1b-2870-4ad9-8299-bf2eb727a286'} Jun 03 10:08:51.768991 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:08:51.768991 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:51.768991 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:08:51.768991 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:08:51.768991 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:08:51.768991 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:08:51.768991 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:08:51.768991 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:08:51.768991 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:08:51.768991 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:08:51.768991 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efe3cd1b-2870-4ad9-8299-bf2eb727a286 could not be found. Jun 03 10:08:51.768991 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:08:51.768991 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:08:51.768991 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:08:51.768991 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:51.768991 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:08:51.768991 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:08:51.768991 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:08:51.768991 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:08:51.768991 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:08:51.770546 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:08:51.770546 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:08:51.770546 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:08:51.770546 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:08:51.770546 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:08:51.770546 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:08:51.770546 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:08:51.770546 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efe3cd1b-2870-4ad9-8299-bf2eb727a286 could not be found. Jun 03 10:08:51.770546 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:08:51.770546 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:08:51.770546 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:08:51.770546 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:51.770546 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:08:51.770546 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:08:51.770546 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:08:51.770546 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:08:51.770546 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efe3cd1b-2870-4ad9-8299-bf2eb727a286 could not be found. Jun 03 10:08:51.770546 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:08:51.771868 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-949c1c12-1f6b-44f0-b1d7-09eb3f5a472e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Returning 404 to user: Instance efe3cd1b-2870-4ad9-8299-bf2eb727a286 could not be found. {{(pid=125065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:08:51.771868 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-949c1c12-1f6b-44f0-b1d7-09eb3f5a472e tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286" status: 404 len: 111 microversion: 2.1 time: 0.029847 Jun 03 10:08:51.771868 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 545/1071] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:51 2022] GET /compute/v2.1/servers/efe3cd1b-2870-4ad9-8299-bf2eb727a286 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:08:52.536562 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-bb587382-d86c-4cd6-8573-ef9298da8005 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:52.537182 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-bb587382-d86c-4cd6-8573-ef9298da8005 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: ba348d8e-b108-46ae-8ef2-db977c9ca0d6] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:52.544088 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bb587382-d86c-4cd6-8573-ef9298da8005 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:52.544539 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bb587382-d86c-4cd6-8573-ef9298da8005 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:52.545297 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bb587382-d86c-4cd6-8573-ef9298da8005 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:52.545739 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bb587382-d86c-4cd6-8573-ef9298da8005 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:52.740332 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-bb587382-d86c-4cd6-8573-ef9298da8005 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:52.747856 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-bb587382-d86c-4cd6-8573-ef9298da8005 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6" status: 200 len: 1578 microversion: 2.1 time: 0.215153 Jun 03 10:08:52.748457 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 527/1072] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:52 2022] GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6 => generated 1578 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:53.030301 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-d09b9892-2343-48b3-82c9-81a691f11403 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:53.030813 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-d09b9892-2343-48b3-82c9-81a691f11403 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:53.037324 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d09b9892-2343-48b3-82c9-81a691f11403 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:53.039687 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d09b9892-2343-48b3-82c9-81a691f11403 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:53.040494 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d09b9892-2343-48b3-82c9-81a691f11403 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:53.040942 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-d09b9892-2343-48b3-82c9-81a691f11403 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:53.054690 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.wsgi [None req-d09b9892-2343-48b3-82c9-81a691f11403 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] HTTP exception thrown: Instance 21c2fa33-3843-4029-a7af-ae2571f5a372 could not be found. Jun 03 10:08:53.056298 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-d09b9892-2343-48b3-82c9-81a691f11403 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Request method failure captured: Jun 03 10:08:53.056298 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: request: DELETE /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372 HTTP/1.1 Jun 03 10:08:53.056298 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept: application/json Jun 03 10:08:53.056298 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept-Encoding: identity Jun 03 10:08:53.056298 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Connection: close Jun 03 10:08:53.056298 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Length: 0 Jun 03 10:08:53.056298 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Type: application/json Jun 03 10:08:53.056298 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Host: 10.222.0.42 Jun 03 10:08:53.056298 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Openstack-System-Scope: None Jun 03 10:08:53.056298 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: User-Agent: python-urllib3/1.26.9 Jun 03 10:08:53.056298 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Auth-Token: gAAAAABimdyERpWAQe95aVogk3CBzbbvoVqsT1mcXcyeAA1KIeWqlrXYLL74Vx2g9GU9bQbymV8F-OiCfQLZd3XmBfURzXWp91tRpkL6WEAH_Q17Tl2wrUlWolA1gi8vDdxsnFf79KdskWgeoWa8fRazmnte5HviUSJ7Rm7SGX5FgU84B4GApr0 Jun 03 10:08:53.056298 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Id: None Jun 03 10:08:53.056298 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Name: None Jun 03 10:08:53.056298 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Identity-Status: Confirmed Jun 03 10:08:53.056298 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Is-Admin-Project: True Jun 03 10:08:53.056298 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Id: default Jun 03 10:08:53.056298 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Name: Default Jun 03 10:08:53.056298 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Id: 3e51010dd5d84daf8aa43859e9e7cb6d Jun 03 10:08:53.056298 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Name: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:08:53.056298 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Role: member,reader Jun 03 10:08:53.056298 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Roles: member,reader Jun 03 10:08:53.057943 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3e51010dd5d84daf8aa43859e9e7cb6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e51010dd5d84daf8aa43859e9e7cb6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3e51010dd5d84daf8aa43859e9e7cb6d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e51010dd5d84daf8aa43859e9e7cb6d"}]}] Jun 03 10:08:53.057943 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:08:53.057943 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Id: 3e51010dd5d84daf8aa43859e9e7cb6d Jun 03 10:08:53.057943 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:08:53.057943 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User: tempest-AttachVolumeNegativeTest-1165735283-project Jun 03 10:08:53.057943 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Id: default Jun 03 10:08:53.057943 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Name: Default Jun 03 10:08:53.057943 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Id: ce77221a2c8d4c4395bed092c1967b28 Jun 03 10:08:53.057943 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Name: tempest-AttachVolumeNegativeTest-1165735283-project Jun 03 10:08:53.057943 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: method: > Jun 03 10:08:53.057943 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: exception: Instance 21c2fa33-3843-4029-a7af-ae2571f5a372 could not be found. Jun 03 10:08:53.057943 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: action_args: {'id': '21c2fa33-3843-4029-a7af-ae2571f5a372'} Jun 03 10:08:53.058778 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:08:53.058778 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:53.058778 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:08:53.058778 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:08:53.058778 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:08:53.058778 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:08:53.058778 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:08:53.058778 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:08:53.058778 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:08:53.058778 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:08:53.058778 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21c2fa33-3843-4029-a7af-ae2571f5a372 could not be found. Jun 03 10:08:53.058778 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:08:53.058778 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:08:53.058778 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:08:53.058778 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:53.058778 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:08:53.058778 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:08:53.058778 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:08:53.058778 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:08:53.058778 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:08:53.059986 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:08:53.059986 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 10:08:53.059986 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 10:08:53.059986 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 10:08:53.059986 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 10:08:53.059986 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:08:53.059986 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:08:53.059986 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:08:53.059986 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:08:53.059986 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21c2fa33-3843-4029-a7af-ae2571f5a372 could not be found. Jun 03 10:08:53.059986 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:08:53.059986 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:08:53.059986 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:08:53.059986 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:53.059986 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:08:53.059986 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:08:53.059986 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:08:53.059986 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:08:53.059986 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21c2fa33-3843-4029-a7af-ae2571f5a372 could not be found. Jun 03 10:08:53.059986 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:08:53.061216 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-d09b9892-2343-48b3-82c9-81a691f11403 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Returning 404 to user: Instance 21c2fa33-3843-4029-a7af-ae2571f5a372 could not be found. {{(pid=125065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:08:53.061216 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-d09b9892-2343-48b3-82c9-81a691f11403 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "DELETE /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372" status: 404 len: 111 microversion: 2.1 time: 0.031343 Jun 03 10:08:53.061216 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 546/1073] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 3 10:08:53 2022] DELETE /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:08:53.066732 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-30d4e772-979d-436b-94cc-ef54101948bf tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:53.067344 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-30d4e772-979d-436b-94cc-ef54101948bf tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 21c2fa33-3843-4029-a7af-ae2571f5a372] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:53.074014 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-30d4e772-979d-436b-94cc-ef54101948bf tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:53.074468 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-30d4e772-979d-436b-94cc-ef54101948bf tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:53.075229 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-30d4e772-979d-436b-94cc-ef54101948bf tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:53.075667 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-30d4e772-979d-436b-94cc-ef54101948bf tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:53.089408 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.wsgi [None req-30d4e772-979d-436b-94cc-ef54101948bf tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] HTTP exception thrown: Instance 21c2fa33-3843-4029-a7af-ae2571f5a372 could not be found. Jun 03 10:08:53.090953 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-30d4e772-979d-436b-94cc-ef54101948bf tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Request method failure captured: Jun 03 10:08:53.090953 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: request: GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372 HTTP/1.1 Jun 03 10:08:53.090953 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept: application/json Jun 03 10:08:53.090953 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept-Encoding: identity Jun 03 10:08:53.090953 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Connection: close Jun 03 10:08:53.090953 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Length: 0 Jun 03 10:08:53.090953 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Type: application/json Jun 03 10:08:53.090953 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Host: 10.222.0.42 Jun 03 10:08:53.090953 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Openstack-System-Scope: None Jun 03 10:08:53.090953 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: User-Agent: python-urllib3/1.26.9 Jun 03 10:08:53.090953 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Auth-Token: gAAAAABimdyERpWAQe95aVogk3CBzbbvoVqsT1mcXcyeAA1KIeWqlrXYLL74Vx2g9GU9bQbymV8F-OiCfQLZd3XmBfURzXWp91tRpkL6WEAH_Q17Tl2wrUlWolA1gi8vDdxsnFf79KdskWgeoWa8fRazmnte5HviUSJ7Rm7SGX5FgU84B4GApr0 Jun 03 10:08:53.090953 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Id: None Jun 03 10:08:53.090953 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Name: None Jun 03 10:08:53.090953 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Identity-Status: Confirmed Jun 03 10:08:53.090953 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Is-Admin-Project: True Jun 03 10:08:53.090953 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Id: default Jun 03 10:08:53.090953 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Name: Default Jun 03 10:08:53.090953 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Id: 3e51010dd5d84daf8aa43859e9e7cb6d Jun 03 10:08:53.090953 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Name: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:08:53.090953 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Role: member,reader Jun 03 10:08:53.090953 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Roles: member,reader Jun 03 10:08:53.092490 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3e51010dd5d84daf8aa43859e9e7cb6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e51010dd5d84daf8aa43859e9e7cb6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3e51010dd5d84daf8aa43859e9e7cb6d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e51010dd5d84daf8aa43859e9e7cb6d"}]}] Jun 03 10:08:53.092490 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:08:53.092490 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Id: 3e51010dd5d84daf8aa43859e9e7cb6d Jun 03 10:08:53.092490 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:08:53.092490 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User: tempest-AttachVolumeNegativeTest-1165735283-project Jun 03 10:08:53.092490 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Id: default Jun 03 10:08:53.092490 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Name: Default Jun 03 10:08:53.092490 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Id: ce77221a2c8d4c4395bed092c1967b28 Jun 03 10:08:53.092490 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Name: tempest-AttachVolumeNegativeTest-1165735283-project Jun 03 10:08:53.092490 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: method: > Jun 03 10:08:53.092490 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: exception: Instance 21c2fa33-3843-4029-a7af-ae2571f5a372 could not be found. Jun 03 10:08:53.092490 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: action_args: {'id': '21c2fa33-3843-4029-a7af-ae2571f5a372'} Jun 03 10:08:53.093342 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:08:53.093342 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:53.093342 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:08:53.093342 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:08:53.093342 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:08:53.093342 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:08:53.093342 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:08:53.093342 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:08:53.093342 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:08:53.093342 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:08:53.093342 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21c2fa33-3843-4029-a7af-ae2571f5a372 could not be found. Jun 03 10:08:53.093342 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:08:53.093342 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:08:53.093342 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:08:53.093342 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:53.093342 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:08:53.093342 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:08:53.093342 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:08:53.093342 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:08:53.093342 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:08:53.094596 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:08:53.094596 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:08:53.094596 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:08:53.094596 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:08:53.094596 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:08:53.094596 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:08:53.094596 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:08:53.094596 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21c2fa33-3843-4029-a7af-ae2571f5a372 could not be found. Jun 03 10:08:53.094596 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:08:53.094596 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:08:53.094596 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:08:53.094596 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:53.094596 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:08:53.094596 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:08:53.094596 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:08:53.094596 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:08:53.094596 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21c2fa33-3843-4029-a7af-ae2571f5a372 could not be found. Jun 03 10:08:53.094596 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:08:53.095699 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-30d4e772-979d-436b-94cc-ef54101948bf tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Returning 404 to user: Instance 21c2fa33-3843-4029-a7af-ae2571f5a372 could not be found. {{(pid=125066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:08:53.095699 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-30d4e772-979d-436b-94cc-ef54101948bf tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372" status: 404 len: 111 microversion: 2.1 time: 0.029655 Jun 03 10:08:53.095699 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 528/1074] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:53 2022] GET /compute/v2.1/servers/21c2fa33-3843-4029-a7af-ae2571f5a372 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:08:53.101264 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-f75e8c47-03b5-4c44-81dd-c21ccb61907c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:53.101712 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-f75e8c47-03b5-4c44-81dd-c21ccb61907c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: aa10760a-d45e-497a-8f67-9cd6ed2eb585] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:53.108696 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f75e8c47-03b5-4c44-81dd-c21ccb61907c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:53.109157 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f75e8c47-03b5-4c44-81dd-c21ccb61907c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:53.109955 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f75e8c47-03b5-4c44-81dd-c21ccb61907c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:53.110531 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-f75e8c47-03b5-4c44-81dd-c21ccb61907c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:53.124380 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.wsgi [None req-f75e8c47-03b5-4c44-81dd-c21ccb61907c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] HTTP exception thrown: Instance aa10760a-d45e-497a-8f67-9cd6ed2eb585 could not be found. Jun 03 10:08:53.125950 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-f75e8c47-03b5-4c44-81dd-c21ccb61907c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Request method failure captured: Jun 03 10:08:53.125950 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: request: DELETE /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585 HTTP/1.1 Jun 03 10:08:53.125950 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept: application/json Jun 03 10:08:53.125950 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept-Encoding: identity Jun 03 10:08:53.125950 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Connection: close Jun 03 10:08:53.125950 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Length: 0 Jun 03 10:08:53.125950 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Type: application/json Jun 03 10:08:53.125950 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Host: 10.222.0.42 Jun 03 10:08:53.125950 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Openstack-System-Scope: None Jun 03 10:08:53.125950 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: User-Agent: python-urllib3/1.26.9 Jun 03 10:08:53.125950 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Auth-Token: gAAAAABimdyERpWAQe95aVogk3CBzbbvoVqsT1mcXcyeAA1KIeWqlrXYLL74Vx2g9GU9bQbymV8F-OiCfQLZd3XmBfURzXWp91tRpkL6WEAH_Q17Tl2wrUlWolA1gi8vDdxsnFf79KdskWgeoWa8fRazmnte5HviUSJ7Rm7SGX5FgU84B4GApr0 Jun 03 10:08:53.125950 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Id: None Jun 03 10:08:53.125950 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Name: None Jun 03 10:08:53.125950 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Identity-Status: Confirmed Jun 03 10:08:53.125950 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Is-Admin-Project: True Jun 03 10:08:53.125950 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Id: default Jun 03 10:08:53.125950 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Name: Default Jun 03 10:08:53.125950 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Id: 3e51010dd5d84daf8aa43859e9e7cb6d Jun 03 10:08:53.125950 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Name: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:08:53.125950 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Role: member,reader Jun 03 10:08:53.125950 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Roles: member,reader Jun 03 10:08:53.127547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3e51010dd5d84daf8aa43859e9e7cb6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e51010dd5d84daf8aa43859e9e7cb6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3e51010dd5d84daf8aa43859e9e7cb6d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e51010dd5d84daf8aa43859e9e7cb6d"}]}] Jun 03 10:08:53.127547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:08:53.127547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Id: 3e51010dd5d84daf8aa43859e9e7cb6d Jun 03 10:08:53.127547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:08:53.127547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User: tempest-AttachVolumeNegativeTest-1165735283-project Jun 03 10:08:53.127547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Id: default Jun 03 10:08:53.127547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Name: Default Jun 03 10:08:53.127547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Id: ce77221a2c8d4c4395bed092c1967b28 Jun 03 10:08:53.127547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Name: tempest-AttachVolumeNegativeTest-1165735283-project Jun 03 10:08:53.127547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: method: > Jun 03 10:08:53.127547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: exception: Instance aa10760a-d45e-497a-8f67-9cd6ed2eb585 could not be found. Jun 03 10:08:53.127547 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: action_args: {'id': 'aa10760a-d45e-497a-8f67-9cd6ed2eb585'} Jun 03 10:08:53.128346 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:08:53.128346 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:53.128346 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:08:53.128346 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:08:53.128346 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:08:53.128346 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:08:53.128346 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:08:53.128346 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:08:53.128346 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:08:53.128346 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:08:53.128346 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa10760a-d45e-497a-8f67-9cd6ed2eb585 could not be found. Jun 03 10:08:53.128346 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:08:53.128346 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:08:53.128346 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:08:53.128346 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:53.128346 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:08:53.128346 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:08:53.128346 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:08:53.128346 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:08:53.128346 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:08:53.130180 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:08:53.130180 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 10:08:53.130180 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 10:08:53.130180 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 10:08:53.130180 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 10:08:53.130180 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:08:53.130180 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:08:53.130180 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:08:53.130180 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:08:53.130180 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa10760a-d45e-497a-8f67-9cd6ed2eb585 could not be found. Jun 03 10:08:53.130180 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:08:53.130180 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:08:53.130180 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:08:53.130180 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:53.130180 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:08:53.130180 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:08:53.130180 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:08:53.130180 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:08:53.130180 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa10760a-d45e-497a-8f67-9cd6ed2eb585 could not be found. Jun 03 10:08:53.130180 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:08:53.132101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-f75e8c47-03b5-4c44-81dd-c21ccb61907c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Returning 404 to user: Instance aa10760a-d45e-497a-8f67-9cd6ed2eb585 could not be found. {{(pid=125065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:08:53.132101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-f75e8c47-03b5-4c44-81dd-c21ccb61907c tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "DELETE /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585" status: 404 len: 111 microversion: 2.1 time: 0.030178 Jun 03 10:08:53.132101 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 547/1075] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 3 10:08:53 2022] DELETE /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:08:53.137163 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-4895eb3e-36dd-4f2e-bbad-e570817b58da tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:53.137913 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-4895eb3e-36dd-4f2e-bbad-e570817b58da tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: aa10760a-d45e-497a-8f67-9cd6ed2eb585] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:53.144106 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4895eb3e-36dd-4f2e-bbad-e570817b58da tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:53.144623 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4895eb3e-36dd-4f2e-bbad-e570817b58da tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:53.145444 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4895eb3e-36dd-4f2e-bbad-e570817b58da tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:53.145977 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-4895eb3e-36dd-4f2e-bbad-e570817b58da tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:53.159989 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.wsgi [None req-4895eb3e-36dd-4f2e-bbad-e570817b58da tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] HTTP exception thrown: Instance aa10760a-d45e-497a-8f67-9cd6ed2eb585 could not be found. Jun 03 10:08:53.161567 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-4895eb3e-36dd-4f2e-bbad-e570817b58da tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Request method failure captured: Jun 03 10:08:53.161567 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: request: GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585 HTTP/1.1 Jun 03 10:08:53.161567 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept: application/json Jun 03 10:08:53.161567 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept-Encoding: identity Jun 03 10:08:53.161567 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Connection: close Jun 03 10:08:53.161567 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Length: 0 Jun 03 10:08:53.161567 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Type: application/json Jun 03 10:08:53.161567 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Host: 10.222.0.42 Jun 03 10:08:53.161567 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Openstack-System-Scope: None Jun 03 10:08:53.161567 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: User-Agent: python-urllib3/1.26.9 Jun 03 10:08:53.161567 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Auth-Token: gAAAAABimdyERpWAQe95aVogk3CBzbbvoVqsT1mcXcyeAA1KIeWqlrXYLL74Vx2g9GU9bQbymV8F-OiCfQLZd3XmBfURzXWp91tRpkL6WEAH_Q17Tl2wrUlWolA1gi8vDdxsnFf79KdskWgeoWa8fRazmnte5HviUSJ7Rm7SGX5FgU84B4GApr0 Jun 03 10:08:53.161567 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Id: None Jun 03 10:08:53.161567 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Name: None Jun 03 10:08:53.161567 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Identity-Status: Confirmed Jun 03 10:08:53.161567 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Is-Admin-Project: True Jun 03 10:08:53.161567 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Id: default Jun 03 10:08:53.161567 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Name: Default Jun 03 10:08:53.161567 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Id: 3e51010dd5d84daf8aa43859e9e7cb6d Jun 03 10:08:53.161567 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Name: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:08:53.161567 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Role: member,reader Jun 03 10:08:53.161567 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Roles: member,reader Jun 03 10:08:53.163747 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3e51010dd5d84daf8aa43859e9e7cb6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e51010dd5d84daf8aa43859e9e7cb6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3e51010dd5d84daf8aa43859e9e7cb6d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e51010dd5d84daf8aa43859e9e7cb6d"}]}] Jun 03 10:08:53.163747 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:08:53.163747 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Id: 3e51010dd5d84daf8aa43859e9e7cb6d Jun 03 10:08:53.163747 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:08:53.163747 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User: tempest-AttachVolumeNegativeTest-1165735283-project Jun 03 10:08:53.163747 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Id: default Jun 03 10:08:53.163747 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Name: Default Jun 03 10:08:53.163747 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Id: ce77221a2c8d4c4395bed092c1967b28 Jun 03 10:08:53.163747 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Name: tempest-AttachVolumeNegativeTest-1165735283-project Jun 03 10:08:53.163747 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: method: > Jun 03 10:08:53.163747 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: exception: Instance aa10760a-d45e-497a-8f67-9cd6ed2eb585 could not be found. Jun 03 10:08:53.163747 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: action_args: {'id': 'aa10760a-d45e-497a-8f67-9cd6ed2eb585'} Jun 03 10:08:53.164653 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:08:53.164653 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:53.164653 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:08:53.164653 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:08:53.164653 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:08:53.164653 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:08:53.164653 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:08:53.164653 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:08:53.164653 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:08:53.164653 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:08:53.164653 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa10760a-d45e-497a-8f67-9cd6ed2eb585 could not be found. Jun 03 10:08:53.164653 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:08:53.164653 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:08:53.164653 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:08:53.164653 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:53.164653 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:08:53.164653 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:08:53.164653 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:08:53.164653 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:08:53.164653 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:08:53.166346 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:08:53.166346 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:08:53.166346 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:08:53.166346 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:08:53.166346 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:08:53.166346 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:08:53.166346 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:08:53.166346 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa10760a-d45e-497a-8f67-9cd6ed2eb585 could not be found. Jun 03 10:08:53.166346 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:08:53.166346 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:08:53.166346 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:08:53.166346 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:53.166346 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:08:53.166346 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:08:53.166346 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:08:53.166346 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:08:53.166346 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa10760a-d45e-497a-8f67-9cd6ed2eb585 could not be found. Jun 03 10:08:53.166346 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:08:53.167692 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-4895eb3e-36dd-4f2e-bbad-e570817b58da tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Returning 404 to user: Instance aa10760a-d45e-497a-8f67-9cd6ed2eb585 could not be found. {{(pid=125066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:08:53.167692 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-4895eb3e-36dd-4f2e-bbad-e570817b58da tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585" status: 404 len: 111 microversion: 2.1 time: 0.031431 Jun 03 10:08:53.168070 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 529/1076] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:53 2022] GET /compute/v2.1/servers/aa10760a-d45e-497a-8f67-9cd6ed2eb585 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:08:53.550566 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-752759e9-835a-4343-aa4a-b9a1962358b5 req-bd088900-a5f0-48d5-862d-15beae2e21fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba348d8e-b108-46ae-8ef2-db977c9ca0d6", "name": "network-vif-deleted", "tag": "ddeb8364-fea9-49e6-8361-912b3e7116bb"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:08:53.560954 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-752759e9-835a-4343-aa4a-b9a1962358b5 req-bd088900-a5f0-48d5-862d-15beae2e21fb service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:53.562818 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-752759e9-835a-4343-aa4a-b9a1962358b5 req-bd088900-a5f0-48d5-862d-15beae2e21fb service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:53.573398 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-752759e9-835a-4343-aa4a-b9a1962358b5 req-bd088900-a5f0-48d5-862d-15beae2e21fb service nova] Creating event network-vif-deleted:ddeb8364-fea9-49e6-8361-912b3e7116bb for instance ba348d8e-b108-46ae-8ef2-db977c9ca0d6 on hv-cinder-84456 Jun 03 10:08:53.578417 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-752759e9-835a-4343-aa4a-b9a1962358b5 req-bd088900-a5f0-48d5-862d-15beae2e21fb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031644 Jun 03 10:08:53.579027 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 548/1077] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:08:53.764707 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-bb03f6cf-b29a-4537-be1c-1f315271fa3d tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:53.765252 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-bb03f6cf-b29a-4537-be1c-1f315271fa3d tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: ba348d8e-b108-46ae-8ef2-db977c9ca0d6] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:53.771749 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bb03f6cf-b29a-4537-be1c-1f315271fa3d tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:53.772198 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bb03f6cf-b29a-4537-be1c-1f315271fa3d tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:53.772957 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bb03f6cf-b29a-4537-be1c-1f315271fa3d tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:53.773396 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-bb03f6cf-b29a-4537-be1c-1f315271fa3d tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:53.838728 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-bb03f6cf-b29a-4537-be1c-1f315271fa3d tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:53.846966 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-bb03f6cf-b29a-4537-be1c-1f315271fa3d tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6" status: 200 len: 1226 microversion: 2.1 time: 0.086072 Jun 03 10:08:53.849439 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 530/1078] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:53 2022] GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:54.436570 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-07376850-07ba-427e-b76a-58fbdb95a131 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:54.437149 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-07376850-07ba-427e-b76a-58fbdb95a131 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 17b2f507-9340-486f-92ed-d249b5b78d78] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:54.443561 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-07376850-07ba-427e-b76a-58fbdb95a131 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:54.444009 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-07376850-07ba-427e-b76a-58fbdb95a131 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:54.444768 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-07376850-07ba-427e-b76a-58fbdb95a131 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:54.445230 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-07376850-07ba-427e-b76a-58fbdb95a131 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:54.458347 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.wsgi [None req-07376850-07ba-427e-b76a-58fbdb95a131 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] HTTP exception thrown: Instance 17b2f507-9340-486f-92ed-d249b5b78d78 could not be found. Jun 03 10:08:54.460469 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-07376850-07ba-427e-b76a-58fbdb95a131 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Request method failure captured: Jun 03 10:08:54.460469 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: request: DELETE /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78 HTTP/1.1 Jun 03 10:08:54.460469 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept: application/json Jun 03 10:08:54.460469 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept-Encoding: identity Jun 03 10:08:54.460469 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Connection: close Jun 03 10:08:54.460469 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Length: 0 Jun 03 10:08:54.460469 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Type: application/json Jun 03 10:08:54.460469 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Host: 10.222.0.42 Jun 03 10:08:54.460469 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Openstack-System-Scope: None Jun 03 10:08:54.460469 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: User-Agent: python-urllib3/1.26.9 Jun 03 10:08:54.460469 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Auth-Token: gAAAAABimdyERpWAQe95aVogk3CBzbbvoVqsT1mcXcyeAA1KIeWqlrXYLL74Vx2g9GU9bQbymV8F-OiCfQLZd3XmBfURzXWp91tRpkL6WEAH_Q17Tl2wrUlWolA1gi8vDdxsnFf79KdskWgeoWa8fRazmnte5HviUSJ7Rm7SGX5FgU84B4GApr0 Jun 03 10:08:54.460469 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Id: None Jun 03 10:08:54.460469 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Name: None Jun 03 10:08:54.460469 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Identity-Status: Confirmed Jun 03 10:08:54.460469 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Is-Admin-Project: True Jun 03 10:08:54.460469 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Id: default Jun 03 10:08:54.460469 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Name: Default Jun 03 10:08:54.460469 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Id: 3e51010dd5d84daf8aa43859e9e7cb6d Jun 03 10:08:54.460469 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Name: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:08:54.460469 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Role: member,reader Jun 03 10:08:54.460469 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Roles: member,reader Jun 03 10:08:54.462091 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3e51010dd5d84daf8aa43859e9e7cb6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e51010dd5d84daf8aa43859e9e7cb6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3e51010dd5d84daf8aa43859e9e7cb6d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e51010dd5d84daf8aa43859e9e7cb6d"}]}] Jun 03 10:08:54.462091 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:08:54.462091 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Id: 3e51010dd5d84daf8aa43859e9e7cb6d Jun 03 10:08:54.462091 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:08:54.462091 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User: tempest-AttachVolumeNegativeTest-1165735283-project Jun 03 10:08:54.462091 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Id: default Jun 03 10:08:54.462091 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Name: Default Jun 03 10:08:54.462091 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Id: ce77221a2c8d4c4395bed092c1967b28 Jun 03 10:08:54.462091 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Name: tempest-AttachVolumeNegativeTest-1165735283-project Jun 03 10:08:54.462091 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: method: > Jun 03 10:08:54.462091 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: exception: Instance 17b2f507-9340-486f-92ed-d249b5b78d78 could not be found. Jun 03 10:08:54.462091 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: action_args: {'id': '17b2f507-9340-486f-92ed-d249b5b78d78'} Jun 03 10:08:54.463187 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:08:54.463187 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:54.463187 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:08:54.463187 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:08:54.463187 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:08:54.463187 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:08:54.463187 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:08:54.463187 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:08:54.463187 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:08:54.463187 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:08:54.463187 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17b2f507-9340-486f-92ed-d249b5b78d78 could not be found. Jun 03 10:08:54.463187 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:08:54.463187 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:08:54.463187 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:08:54.463187 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:54.463187 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:08:54.463187 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:08:54.463187 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:08:54.463187 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:08:54.463187 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:08:54.464697 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:08:54.464697 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 10:08:54.464697 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 10:08:54.464697 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 10:08:54.464697 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 10:08:54.464697 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:08:54.464697 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:08:54.464697 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:08:54.464697 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:08:54.464697 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17b2f507-9340-486f-92ed-d249b5b78d78 could not be found. Jun 03 10:08:54.464697 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:08:54.464697 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:08:54.464697 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:08:54.464697 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:54.464697 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:08:54.464697 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:08:54.464697 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:08:54.464697 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:08:54.464697 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17b2f507-9340-486f-92ed-d249b5b78d78 could not be found. Jun 03 10:08:54.464697 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:08:54.466391 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-07376850-07ba-427e-b76a-58fbdb95a131 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Returning 404 to user: Instance 17b2f507-9340-486f-92ed-d249b5b78d78 could not be found. {{(pid=125065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:08:54.466391 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-07376850-07ba-427e-b76a-58fbdb95a131 tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "DELETE /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78" status: 404 len: 111 microversion: 2.1 time: 0.029986 Jun 03 10:08:54.466391 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 549/1079] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 3 10:08:54 2022] DELETE /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:08:54.469968 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-5e5123ff-5439-438b-b8f9-2283ad1b88ba tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:54.470607 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-5e5123ff-5439-438b-b8f9-2283ad1b88ba tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] [instance: 17b2f507-9340-486f-92ed-d249b5b78d78] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:54.477231 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5e5123ff-5439-438b-b8f9-2283ad1b88ba tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:54.477690 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5e5123ff-5439-438b-b8f9-2283ad1b88ba tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:54.478450 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5e5123ff-5439-438b-b8f9-2283ad1b88ba tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:54.478879 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5e5123ff-5439-438b-b8f9-2283ad1b88ba tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:54.493345 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.wsgi [None req-5e5123ff-5439-438b-b8f9-2283ad1b88ba tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] HTTP exception thrown: Instance 17b2f507-9340-486f-92ed-d249b5b78d78 could not be found. Jun 03 10:08:54.494854 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-5e5123ff-5439-438b-b8f9-2283ad1b88ba tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Request method failure captured: Jun 03 10:08:54.494854 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: request: GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78 HTTP/1.1 Jun 03 10:08:54.494854 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept: application/json Jun 03 10:08:54.494854 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept-Encoding: identity Jun 03 10:08:54.494854 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Connection: close Jun 03 10:08:54.494854 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Length: 0 Jun 03 10:08:54.494854 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Type: application/json Jun 03 10:08:54.494854 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Host: 10.222.0.42 Jun 03 10:08:54.494854 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Openstack-System-Scope: None Jun 03 10:08:54.494854 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: User-Agent: python-urllib3/1.26.9 Jun 03 10:08:54.494854 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Auth-Token: gAAAAABimdyERpWAQe95aVogk3CBzbbvoVqsT1mcXcyeAA1KIeWqlrXYLL74Vx2g9GU9bQbymV8F-OiCfQLZd3XmBfURzXWp91tRpkL6WEAH_Q17Tl2wrUlWolA1gi8vDdxsnFf79KdskWgeoWa8fRazmnte5HviUSJ7Rm7SGX5FgU84B4GApr0 Jun 03 10:08:54.494854 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Id: None Jun 03 10:08:54.494854 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Name: None Jun 03 10:08:54.494854 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Identity-Status: Confirmed Jun 03 10:08:54.494854 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Is-Admin-Project: True Jun 03 10:08:54.494854 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Id: default Jun 03 10:08:54.494854 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Name: Default Jun 03 10:08:54.494854 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Id: 3e51010dd5d84daf8aa43859e9e7cb6d Jun 03 10:08:54.494854 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Name: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:08:54.494854 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Role: member,reader Jun 03 10:08:54.494854 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Roles: member,reader Jun 03 10:08:54.496486 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3e51010dd5d84daf8aa43859e9e7cb6d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e51010dd5d84daf8aa43859e9e7cb6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3e51010dd5d84daf8aa43859e9e7cb6d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e51010dd5d84daf8aa43859e9e7cb6d"}]}] Jun 03 10:08:54.496486 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:08:54.496486 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Id: 3e51010dd5d84daf8aa43859e9e7cb6d Jun 03 10:08:54.496486 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1165735283 Jun 03 10:08:54.496486 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User: tempest-AttachVolumeNegativeTest-1165735283-project Jun 03 10:08:54.496486 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Id: default Jun 03 10:08:54.496486 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Name: Default Jun 03 10:08:54.496486 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Id: ce77221a2c8d4c4395bed092c1967b28 Jun 03 10:08:54.496486 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Name: tempest-AttachVolumeNegativeTest-1165735283-project Jun 03 10:08:54.496486 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: method: > Jun 03 10:08:54.496486 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: exception: Instance 17b2f507-9340-486f-92ed-d249b5b78d78 could not be found. Jun 03 10:08:54.496486 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: action_args: {'id': '17b2f507-9340-486f-92ed-d249b5b78d78'} Jun 03 10:08:54.497304 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:08:54.497304 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:54.497304 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:08:54.497304 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:08:54.497304 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:08:54.497304 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:08:54.497304 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:08:54.497304 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:08:54.497304 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:08:54.497304 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:08:54.497304 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17b2f507-9340-486f-92ed-d249b5b78d78 could not be found. Jun 03 10:08:54.497304 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:08:54.497304 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:08:54.497304 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:08:54.497304 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:54.497304 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:08:54.497304 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:08:54.497304 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:08:54.497304 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:08:54.497304 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:08:54.498582 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:08:54.498582 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:08:54.498582 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:08:54.498582 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:08:54.498582 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:08:54.498582 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:08:54.498582 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:08:54.498582 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17b2f507-9340-486f-92ed-d249b5b78d78 could not be found. Jun 03 10:08:54.498582 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:08:54.498582 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:08:54.498582 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:08:54.498582 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:54.498582 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:08:54.498582 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:08:54.498582 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:08:54.498582 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:08:54.498582 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17b2f507-9340-486f-92ed-d249b5b78d78 could not be found. Jun 03 10:08:54.498582 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:08:54.499701 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-5e5123ff-5439-438b-b8f9-2283ad1b88ba tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] Returning 404 to user: Instance 17b2f507-9340-486f-92ed-d249b5b78d78 could not be found. {{(pid=125066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:08:54.499701 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-5e5123ff-5439-438b-b8f9-2283ad1b88ba tempest-AttachVolumeNegativeTest-1165735283 tempest-AttachVolumeNegativeTest-1165735283-project] 10.222.0.42 "GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78" status: 404 len: 111 microversion: 2.1 time: 0.030002 Jun 03 10:08:54.499701 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 531/1080] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:54 2022] GET /compute/v2.1/servers/17b2f507-9340-486f-92ed-d249b5b78d78 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:08:54.863888 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-cba3f8fc-11b6-4747-9c0c-d3152a071098 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:54.864540 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-cba3f8fc-11b6-4747-9c0c-d3152a071098 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: ba348d8e-b108-46ae-8ef2-db977c9ca0d6] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:54.871218 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-cba3f8fc-11b6-4747-9c0c-d3152a071098 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:54.871669 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-cba3f8fc-11b6-4747-9c0c-d3152a071098 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:54.872483 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-cba3f8fc-11b6-4747-9c0c-d3152a071098 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:54.872925 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-cba3f8fc-11b6-4747-9c0c-d3152a071098 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:54.907181 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-cba3f8fc-11b6-4747-9c0c-d3152a071098 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:54.907639 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-cba3f8fc-11b6-4747-9c0c-d3152a071098 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:54.908110 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.objects.instance [None req-cba3f8fc-11b6-4747-9c0c-d3152a071098 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lazy-loading 'fault' on Instance uuid ba348d8e-b108-46ae-8ef2-db977c9ca0d6 {{(pid=125065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:08:54.951210 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-cba3f8fc-11b6-4747-9c0c-d3152a071098 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:54.958206 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-cba3f8fc-11b6-4747-9c0c-d3152a071098 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6" status: 200 len: 1185 microversion: 2.1 time: 0.098320 Jun 03 10:08:54.959019 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 550/1081] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:54 2022] GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6 => generated 1185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:55.977028 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-cbd777eb-869b-4bcb-ac97-715427a8f378 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:55.977563 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-cbd777eb-869b-4bcb-ac97-715427a8f378 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: ba348d8e-b108-46ae-8ef2-db977c9ca0d6] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:55.984228 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-cbd777eb-869b-4bcb-ac97-715427a8f378 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:55.984673 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-cbd777eb-869b-4bcb-ac97-715427a8f378 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:55.985427 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-cbd777eb-869b-4bcb-ac97-715427a8f378 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:55.985926 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-cbd777eb-869b-4bcb-ac97-715427a8f378 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:55.999428 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.wsgi [None req-cbd777eb-869b-4bcb-ac97-715427a8f378 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] HTTP exception thrown: Instance ba348d8e-b108-46ae-8ef2-db977c9ca0d6 could not be found. Jun 03 10:08:56.000968 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-cbd777eb-869b-4bcb-ac97-715427a8f378 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Request method failure captured: Jun 03 10:08:56.000968 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: request: GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6 HTTP/1.1 Jun 03 10:08:56.000968 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept: application/json Jun 03 10:08:56.000968 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept-Encoding: identity Jun 03 10:08:56.000968 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Connection: close Jun 03 10:08:56.000968 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Length: 0 Jun 03 10:08:56.000968 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Type: application/json Jun 03 10:08:56.000968 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Host: 10.222.0.42 Jun 03 10:08:56.000968 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Openstack-System-Scope: None Jun 03 10:08:56.000968 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: User-Agent: python-urllib3/1.26.9 Jun 03 10:08:56.000968 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Auth-Token: gAAAAABimdvmkmGByaxV5IeFM7hJ72QONjbut4RWYIfFr5aVIbzOjdxlJ9aZ2CQ1SicxV3VleVIT9XOasCRkBeSPwdPEUrCDUvTcJDSl89v9NVB0xtOls7A2GEnUx8NQAn8uXq2UUjCDbFii-wi1XCU9uJe7u4yUSWQzt4fjNcbcMLG98mSuols Jun 03 10:08:56.000968 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Id: None Jun 03 10:08:56.000968 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Name: None Jun 03 10:08:56.000968 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Identity-Status: Confirmed Jun 03 10:08:56.000968 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Is-Admin-Project: True Jun 03 10:08:56.000968 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Id: default Jun 03 10:08:56.000968 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Name: Default Jun 03 10:08:56.000968 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Id: 5476f21b29944eb69e32a2d97b328aed Jun 03 10:08:56.000968 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Name: tempest-TestVolumeBootPattern-70577832 Jun 03 10:08:56.000968 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Role: member,reader Jun 03 10:08:56.000968 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Roles: member,reader Jun 03 10:08:56.002690 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5476f21b29944eb69e32a2d97b328aed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5476f21b29944eb69e32a2d97b328aed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5476f21b29944eb69e32a2d97b328aed", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5476f21b29944eb69e32a2d97b328aed"}]}] Jun 03 10:08:56.002690 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant: tempest-TestVolumeBootPattern-70577832 Jun 03 10:08:56.002690 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Id: 5476f21b29944eb69e32a2d97b328aed Jun 03 10:08:56.002690 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Name: tempest-TestVolumeBootPattern-70577832 Jun 03 10:08:56.002690 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User: tempest-TestVolumeBootPattern-70577832-project Jun 03 10:08:56.002690 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Id: default Jun 03 10:08:56.002690 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Name: Default Jun 03 10:08:56.002690 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Id: 646fecf4405c41a0bc062c6b54fd311c Jun 03 10:08:56.002690 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Name: tempest-TestVolumeBootPattern-70577832-project Jun 03 10:08:56.002690 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: method: > Jun 03 10:08:56.002690 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: exception: Instance ba348d8e-b108-46ae-8ef2-db977c9ca0d6 could not be found. Jun 03 10:08:56.002690 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: action_args: {'id': 'ba348d8e-b108-46ae-8ef2-db977c9ca0d6'} Jun 03 10:08:56.004282 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:08:56.004282 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:56.004282 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:08:56.004282 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:08:56.004282 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:08:56.004282 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:08:56.004282 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:08:56.004282 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:08:56.004282 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:08:56.004282 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:08:56.004282 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba348d8e-b108-46ae-8ef2-db977c9ca0d6 could not be found. Jun 03 10:08:56.004282 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:08:56.004282 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:08:56.004282 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:08:56.004282 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:56.004282 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:08:56.004282 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:08:56.004282 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:08:56.004282 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:08:56.004282 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:08:56.005776 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:08:56.005776 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:08:56.005776 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:08:56.005776 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:08:56.005776 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:08:56.005776 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:08:56.005776 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:08:56.005776 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba348d8e-b108-46ae-8ef2-db977c9ca0d6 could not be found. Jun 03 10:08:56.005776 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:08:56.005776 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:08:56.005776 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:08:56.005776 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:56.005776 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:08:56.005776 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:08:56.005776 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:08:56.005776 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:08:56.005776 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba348d8e-b108-46ae-8ef2-db977c9ca0d6 could not be found. Jun 03 10:08:56.005776 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:08:56.007889 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-cbd777eb-869b-4bcb-ac97-715427a8f378 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Returning 404 to user: Instance ba348d8e-b108-46ae-8ef2-db977c9ca0d6 could not be found. {{(pid=125066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:08:56.007889 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-cbd777eb-869b-4bcb-ac97-715427a8f378 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6" status: 404 len: 111 microversion: 2.1 time: 0.030000 Jun 03 10:08:56.007889 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 532/1082] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:55 2022] GET /compute/v2.1/servers/ba348d8e-b108-46ae-8ef2-db977c9ca0d6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:08:59.578542 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-11965c06-0746-444e-bdc6-bc442a035943 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:59.579926 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-11965c06-0746-444e-bdc6-bc442a035943 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: acca7e36-982b-4fc4-a4a6-8e34f7b25d7a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:59.581429 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-e68ed111-ddf6-4793-b281-283755e569bb req-addbd638-47a0-468e-94f6-8f1696b783aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acca7e36-982b-4fc4-a4a6-8e34f7b25d7a", "tag": "4bc88b77-b7fa-4b6a-90b4-2750b5baa1c9"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:08:59.591963 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-11965c06-0746-444e-bdc6-bc442a035943 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:59.592727 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-11965c06-0746-444e-bdc6-bc442a035943 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:59.601095 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-11965c06-0746-444e-bdc6-bc442a035943 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:59.601095 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-11965c06-0746-444e-bdc6-bc442a035943 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:59.609904 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-e68ed111-ddf6-4793-b281-283755e569bb req-addbd638-47a0-468e-94f6-8f1696b783aa service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:59.610622 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-e68ed111-ddf6-4793-b281-283755e569bb req-addbd638-47a0-468e-94f6-8f1696b783aa service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:59.623817 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-e68ed111-ddf6-4793-b281-283755e569bb req-addbd638-47a0-468e-94f6-8f1696b783aa service nova] Creating event network-changed:4bc88b77-b7fa-4b6a-90b4-2750b5baa1c9 for instance acca7e36-982b-4fc4-a4a6-8e34f7b25d7a on hv-cinder-84456 Jun 03 10:08:59.629580 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-11965c06-0746-444e-bdc6-bc442a035943 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: acca7e36-982b-4fc4-a4a6-8e34f7b25d7a] Going to try to terminate instance {{(pid=125065) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:08:59.630916 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-e68ed111-ddf6-4793-b281-283755e569bb req-addbd638-47a0-468e-94f6-8f1696b783aa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053999 Jun 03 10:08:59.631104 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 533/1083] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:09:00.023983 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-11965c06-0746-444e-bdc6-bc442a035943 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "DELETE /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a" status: 204 len: 0 microversion: 2.1 time: 0.446022 Jun 03 10:09:00.024283 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 551/1084] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 3 10:08:59 2022] DELETE /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:09:00.033072 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-02151ef6-6235-4e86-ad9d-117bb8d15dcb tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:00.034132 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-02151ef6-6235-4e86-ad9d-117bb8d15dcb tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: acca7e36-982b-4fc4-a4a6-8e34f7b25d7a] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:00.041438 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-02151ef6-6235-4e86-ad9d-117bb8d15dcb tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:00.042160 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-02151ef6-6235-4e86-ad9d-117bb8d15dcb tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:00.043111 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-02151ef6-6235-4e86-ad9d-117bb8d15dcb tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:00.044007 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-02151ef6-6235-4e86-ad9d-117bb8d15dcb tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:00.193215 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-02151ef6-6235-4e86-ad9d-117bb8d15dcb tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:09:00.201823 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-02151ef6-6235-4e86-ad9d-117bb8d15dcb tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a" status: 200 len: 1578 microversion: 2.1 time: 0.173169 Jun 03 10:09:00.202674 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 534/1085] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:00 2022] GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:09:01.220435 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-37866c12-6d9a-4179-8116-10480bcd14fa tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:01.221127 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-37866c12-6d9a-4179-8116-10480bcd14fa tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: acca7e36-982b-4fc4-a4a6-8e34f7b25d7a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:01.228310 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-37866c12-6d9a-4179-8116-10480bcd14fa tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:01.228762 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-37866c12-6d9a-4179-8116-10480bcd14fa tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:01.229521 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-37866c12-6d9a-4179-8116-10480bcd14fa tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:01.229981 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-37866c12-6d9a-4179-8116-10480bcd14fa tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:01.364284 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-37866c12-6d9a-4179-8116-10480bcd14fa tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:09:01.372057 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-37866c12-6d9a-4179-8116-10480bcd14fa tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a" status: 200 len: 1578 microversion: 2.1 time: 0.155845 Jun 03 10:09:01.372630 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 552/1086] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:01 2022] GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:09:02.169007 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-cff86a19-5301-4f76-935d-8c50ee78cec2 req-4332218d-9d3d-4ebd-a2ab-b9e8e89b6e86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acca7e36-982b-4fc4-a4a6-8e34f7b25d7a", "name": "network-vif-deleted", "tag": "4bc88b77-b7fa-4b6a-90b4-2750b5baa1c9"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:09:02.178284 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-cff86a19-5301-4f76-935d-8c50ee78cec2 req-4332218d-9d3d-4ebd-a2ab-b9e8e89b6e86 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:02.181673 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-cff86a19-5301-4f76-935d-8c50ee78cec2 req-4332218d-9d3d-4ebd-a2ab-b9e8e89b6e86 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:02.189961 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-cff86a19-5301-4f76-935d-8c50ee78cec2 req-4332218d-9d3d-4ebd-a2ab-b9e8e89b6e86 service nova] Creating event network-vif-deleted:4bc88b77-b7fa-4b6a-90b4-2750b5baa1c9 for instance acca7e36-982b-4fc4-a4a6-8e34f7b25d7a on hv-cinder-84456 Jun 03 10:09:02.195664 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-cff86a19-5301-4f76-935d-8c50ee78cec2 req-4332218d-9d3d-4ebd-a2ab-b9e8e89b6e86 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030264 Jun 03 10:09:02.196467 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 535/1087] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:09:02.390425 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-9ba4eee1-f19a-4140-96ad-ca3890b1469a tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:02.394582 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-9ba4eee1-f19a-4140-96ad-ca3890b1469a tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: acca7e36-982b-4fc4-a4a6-8e34f7b25d7a] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:02.397035 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9ba4eee1-f19a-4140-96ad-ca3890b1469a tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:02.397560 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9ba4eee1-f19a-4140-96ad-ca3890b1469a tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:02.398347 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9ba4eee1-f19a-4140-96ad-ca3890b1469a tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:02.398781 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-9ba4eee1-f19a-4140-96ad-ca3890b1469a tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:02.466460 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-9ba4eee1-f19a-4140-96ad-ca3890b1469a tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646fecf4405c41a0bc062c6b54fd311c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5476f21b29944eb69e32a2d97b328aed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:09:02.475628 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-9ba4eee1-f19a-4140-96ad-ca3890b1469a tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a" status: 200 len: 1226 microversion: 2.1 time: 0.089369 Jun 03 10:09:02.476300 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 553/1088] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:02 2022] GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:09:03.493590 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-93cd9fec-d588-48ac-88d8-2d9ea228cc18 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:03.494350 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-93cd9fec-d588-48ac-88d8-2d9ea228cc18 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: acca7e36-982b-4fc4-a4a6-8e34f7b25d7a] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:03.508848 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-93cd9fec-d588-48ac-88d8-2d9ea228cc18 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:03.508848 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-93cd9fec-d588-48ac-88d8-2d9ea228cc18 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:03.508848 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-93cd9fec-d588-48ac-88d8-2d9ea228cc18 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:03.508848 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-93cd9fec-d588-48ac-88d8-2d9ea228cc18 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:03.521191 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.wsgi [None req-93cd9fec-d588-48ac-88d8-2d9ea228cc18 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] HTTP exception thrown: Instance acca7e36-982b-4fc4-a4a6-8e34f7b25d7a could not be found. Jun 03 10:09:03.523607 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-93cd9fec-d588-48ac-88d8-2d9ea228cc18 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Request method failure captured: Jun 03 10:09:03.523607 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: request: GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a HTTP/1.1 Jun 03 10:09:03.523607 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept: application/json Jun 03 10:09:03.523607 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept-Encoding: identity Jun 03 10:09:03.523607 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Connection: close Jun 03 10:09:03.523607 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Length: 0 Jun 03 10:09:03.523607 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Type: application/json Jun 03 10:09:03.523607 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Host: 10.222.0.42 Jun 03 10:09:03.523607 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Openstack-System-Scope: None Jun 03 10:09:03.523607 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: User-Agent: python-urllib3/1.26.9 Jun 03 10:09:03.523607 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Auth-Token: gAAAAABimdvmkmGByaxV5IeFM7hJ72QONjbut4RWYIfFr5aVIbzOjdxlJ9aZ2CQ1SicxV3VleVIT9XOasCRkBeSPwdPEUrCDUvTcJDSl89v9NVB0xtOls7A2GEnUx8NQAn8uXq2UUjCDbFii-wi1XCU9uJe7u4yUSWQzt4fjNcbcMLG98mSuols Jun 03 10:09:03.523607 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Id: None Jun 03 10:09:03.523607 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Name: None Jun 03 10:09:03.523607 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Identity-Status: Confirmed Jun 03 10:09:03.523607 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Is-Admin-Project: True Jun 03 10:09:03.523607 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Id: default Jun 03 10:09:03.523607 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Name: Default Jun 03 10:09:03.523607 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Id: 5476f21b29944eb69e32a2d97b328aed Jun 03 10:09:03.523607 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Name: tempest-TestVolumeBootPattern-70577832 Jun 03 10:09:03.523607 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Role: member,reader Jun 03 10:09:03.523607 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Roles: member,reader Jun 03 10:09:03.525119 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5476f21b29944eb69e32a2d97b328aed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5476f21b29944eb69e32a2d97b328aed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5476f21b29944eb69e32a2d97b328aed", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5476f21b29944eb69e32a2d97b328aed"}]}] Jun 03 10:09:03.525119 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant: tempest-TestVolumeBootPattern-70577832 Jun 03 10:09:03.525119 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Id: 5476f21b29944eb69e32a2d97b328aed Jun 03 10:09:03.525119 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Name: tempest-TestVolumeBootPattern-70577832 Jun 03 10:09:03.525119 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User: tempest-TestVolumeBootPattern-70577832-project Jun 03 10:09:03.525119 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Id: default Jun 03 10:09:03.525119 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Name: Default Jun 03 10:09:03.525119 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Id: 646fecf4405c41a0bc062c6b54fd311c Jun 03 10:09:03.525119 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Name: tempest-TestVolumeBootPattern-70577832-project Jun 03 10:09:03.525119 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: method: > Jun 03 10:09:03.525119 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: exception: Instance acca7e36-982b-4fc4-a4a6-8e34f7b25d7a could not be found. Jun 03 10:09:03.525119 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: action_args: {'id': 'acca7e36-982b-4fc4-a4a6-8e34f7b25d7a'} Jun 03 10:09:03.525936 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:09:03.525936 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:09:03.525936 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:09:03.525936 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:09:03.525936 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:09:03.525936 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:09:03.525936 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:09:03.525936 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:09:03.525936 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:09:03.525936 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:09:03.525936 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acca7e36-982b-4fc4-a4a6-8e34f7b25d7a could not be found. Jun 03 10:09:03.525936 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:09:03.525936 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:09:03.525936 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:09:03.525936 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:09:03.525936 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:09:03.525936 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:09:03.525936 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:09:03.525936 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:09:03.525936 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:09:03.527436 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:09:03.527436 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:09:03.527436 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:09:03.527436 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:09:03.527436 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:09:03.527436 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:09:03.527436 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:09:03.527436 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acca7e36-982b-4fc4-a4a6-8e34f7b25d7a could not be found. Jun 03 10:09:03.527436 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:09:03.527436 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:09:03.527436 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:09:03.527436 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:09:03.527436 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:09:03.527436 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:09:03.527436 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:09:03.527436 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:09:03.527436 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acca7e36-982b-4fc4-a4a6-8e34f7b25d7a could not be found. Jun 03 10:09:03.527436 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:09:03.529537 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-93cd9fec-d588-48ac-88d8-2d9ea228cc18 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Returning 404 to user: Instance acca7e36-982b-4fc4-a4a6-8e34f7b25d7a could not be found. {{(pid=125066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:09:03.530430 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-93cd9fec-d588-48ac-88d8-2d9ea228cc18 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a" status: 404 len: 111 microversion: 2.1 time: 0.041660 Jun 03 10:09:03.530995 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 536/1089] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:03 2022] GET /compute/v2.1/servers/acca7e36-982b-4fc4-a4a6-8e34f7b25d7a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:09:03.532728 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-240a8641-c1c5-40a2-bf9b-9d22121136cc tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:09:03.533720 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-240a8641-c1c5-40a2-bf9b-9d22121136cc tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:03.540941 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-240a8641-c1c5-40a2-bf9b-9d22121136cc tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:03.541366 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-240a8641-c1c5-40a2-bf9b-9d22121136cc tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:03.542196 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-240a8641-c1c5-40a2-bf9b-9d22121136cc tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:03.542848 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-240a8641-c1c5-40a2-bf9b-9d22121136cc tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:03.547317 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:09:03.793128 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-240a8641-c1c5-40a2-bf9b-9d22121136cc tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "POST /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9/action" status: 202 len: 0 microversion: 2.1 time: 0.263172 Jun 03 10:09:03.793914 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 554/1090] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jun 3 10:09:03 2022] POST /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 03 10:09:03.802976 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-8cc37716-ff4d-48d7-8fb0-b4cd192a1389 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:03.803818 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-8cc37716-ff4d-48d7-8fb0-b4cd192a1389 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:03.810472 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8cc37716-ff4d-48d7-8fb0-b4cd192a1389 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:03.810955 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8cc37716-ff4d-48d7-8fb0-b4cd192a1389 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:03.811962 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8cc37716-ff4d-48d7-8fb0-b4cd192a1389 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:03.812393 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-8cc37716-ff4d-48d7-8fb0-b4cd192a1389 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:03.815447 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:09:04.078488 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-8cc37716-ff4d-48d7-8fb0-b4cd192a1389 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:09:04.087243 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-8cc37716-ff4d-48d7-8fb0-b4cd192a1389 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1750 microversion: 2.1 time: 0.289162 Jun 03 10:09:04.087813 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 537/1091] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:03 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1750 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:09:04.198419 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-88732273-cb43-4c40-b25a-e52fdc58f856 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:04.199099 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-88732273-cb43-4c40-b25a-e52fdc58f856 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:04.205857 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-88732273-cb43-4c40-b25a-e52fdc58f856 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:04.206334 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-88732273-cb43-4c40-b25a-e52fdc58f856 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:04.207105 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-88732273-cb43-4c40-b25a-e52fdc58f856 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:04.208154 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-88732273-cb43-4c40-b25a-e52fdc58f856 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:04.226447 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.wsgi [None req-88732273-cb43-4c40-b25a-e52fdc58f856 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] HTTP exception thrown: Instance 7b4620df-63bb-4550-b854-4c81bb1219e0 could not be found. Jun 03 10:09:04.226447 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-88732273-cb43-4c40-b25a-e52fdc58f856 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Request method failure captured: Jun 03 10:09:04.226447 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: request: DELETE /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 HTTP/1.1 Jun 03 10:09:04.226447 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept: application/json Jun 03 10:09:04.226447 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Accept-Encoding: identity Jun 03 10:09:04.226447 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Connection: close Jun 03 10:09:04.226447 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Length: 0 Jun 03 10:09:04.226447 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Content-Type: application/json Jun 03 10:09:04.226447 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Host: 10.222.0.42 Jun 03 10:09:04.226447 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Openstack-System-Scope: None Jun 03 10:09:04.226447 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: User-Agent: python-urllib3/1.26.9 Jun 03 10:09:04.226447 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Auth-Token: gAAAAABimdvmkmGByaxV5IeFM7hJ72QONjbut4RWYIfFr5aVIbzOjdxlJ9aZ2CQ1SicxV3VleVIT9XOasCRkBeSPwdPEUrCDUvTcJDSl89v9NVB0xtOls7A2GEnUx8NQAn8uXq2UUjCDbFii-wi1XCU9uJe7u4yUSWQzt4fjNcbcMLG98mSuols Jun 03 10:09:04.226447 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Id: None Jun 03 10:09:04.226447 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Domain-Name: None Jun 03 10:09:04.226447 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Identity-Status: Confirmed Jun 03 10:09:04.226447 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Is-Admin-Project: True Jun 03 10:09:04.226447 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Id: default Jun 03 10:09:04.226447 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Domain-Name: Default Jun 03 10:09:04.226447 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Id: 5476f21b29944eb69e32a2d97b328aed Jun 03 10:09:04.226447 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Project-Name: tempest-TestVolumeBootPattern-70577832 Jun 03 10:09:04.226447 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Role: member,reader Jun 03 10:09:04.226447 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Roles: member,reader Jun 03 10:09:04.228169 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5476f21b29944eb69e32a2d97b328aed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5476f21b29944eb69e32a2d97b328aed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5476f21b29944eb69e32a2d97b328aed", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5476f21b29944eb69e32a2d97b328aed"}]}] Jun 03 10:09:04.228169 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant: tempest-TestVolumeBootPattern-70577832 Jun 03 10:09:04.228169 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Id: 5476f21b29944eb69e32a2d97b328aed Jun 03 10:09:04.228169 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-Tenant-Name: tempest-TestVolumeBootPattern-70577832 Jun 03 10:09:04.228169 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User: tempest-TestVolumeBootPattern-70577832-project Jun 03 10:09:04.228169 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Id: default Jun 03 10:09:04.228169 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Domain-Name: Default Jun 03 10:09:04.228169 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Id: 646fecf4405c41a0bc062c6b54fd311c Jun 03 10:09:04.228169 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: X-User-Name: tempest-TestVolumeBootPattern-70577832-project Jun 03 10:09:04.228169 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: method: > Jun 03 10:09:04.228169 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: exception: Instance 7b4620df-63bb-4550-b854-4c81bb1219e0 could not be found. Jun 03 10:09:04.228169 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: action_args: {'id': '7b4620df-63bb-4550-b854-4c81bb1219e0'} Jun 03 10:09:04.229001 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:09:04.229001 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:09:04.229001 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:09:04.229001 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:09:04.229001 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:09:04.229001 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:09:04.229001 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:09:04.229001 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:09:04.229001 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:09:04.229001 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:09:04.229001 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b4620df-63bb-4550-b854-4c81bb1219e0 could not be found. Jun 03 10:09:04.229001 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:09:04.229001 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:09:04.229001 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:09:04.229001 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:09:04.229001 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:09:04.229001 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:09:04.229001 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:09:04.229001 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:09:04.229001 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:09:04.230361 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:09:04.230361 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 10:09:04.230361 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 10:09:04.230361 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 10:09:04.230361 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 10:09:04.230361 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:09:04.230361 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:09:04.230361 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:09:04.230361 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:09:04.230361 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b4620df-63bb-4550-b854-4c81bb1219e0 could not be found. Jun 03 10:09:04.230361 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:09:04.230361 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:09:04.230361 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:09:04.230361 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:09:04.230361 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:09:04.230361 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:09:04.230361 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:09:04.230361 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:09:04.230361 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b4620df-63bb-4550-b854-4c81bb1219e0 could not be found. Jun 03 10:09:04.230361 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: ERROR nova.api.openstack.wsgi Jun 03 10:09:04.232774 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-88732273-cb43-4c40-b25a-e52fdc58f856 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Returning 404 to user: Instance 7b4620df-63bb-4550-b854-4c81bb1219e0 could not be found. {{(pid=125065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:09:04.232774 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-88732273-cb43-4c40-b25a-e52fdc58f856 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 404 len: 111 microversion: 2.1 time: 0.034154 Jun 03 10:09:04.232774 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 555/1092] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 3 10:09:04 2022] DELETE /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:09:04.236000 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-f920bc63-b4ff-48cd-9d77-05a4e28f9a47 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:04.236776 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-f920bc63-b4ff-48cd-9d77-05a4e28f9a47 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] [instance: 7b4620df-63bb-4550-b854-4c81bb1219e0] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:04.244779 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f920bc63-b4ff-48cd-9d77-05a4e28f9a47 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:04.245237 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f920bc63-b4ff-48cd-9d77-05a4e28f9a47 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:04.246108 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f920bc63-b4ff-48cd-9d77-05a4e28f9a47 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:04.246582 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f920bc63-b4ff-48cd-9d77-05a4e28f9a47 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:04.262828 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.wsgi [None req-f920bc63-b4ff-48cd-9d77-05a4e28f9a47 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] HTTP exception thrown: Instance 7b4620df-63bb-4550-b854-4c81bb1219e0 could not be found. Jun 03 10:09:04.264358 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-f920bc63-b4ff-48cd-9d77-05a4e28f9a47 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Request method failure captured: Jun 03 10:09:04.264358 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: request: GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 HTTP/1.1 Jun 03 10:09:04.264358 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept: application/json Jun 03 10:09:04.264358 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept-Encoding: identity Jun 03 10:09:04.264358 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Connection: close Jun 03 10:09:04.264358 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Length: 0 Jun 03 10:09:04.264358 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Type: application/json Jun 03 10:09:04.264358 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Host: 10.222.0.42 Jun 03 10:09:04.264358 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Openstack-System-Scope: None Jun 03 10:09:04.264358 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: User-Agent: python-urllib3/1.26.9 Jun 03 10:09:04.264358 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Auth-Token: gAAAAABimdvmkmGByaxV5IeFM7hJ72QONjbut4RWYIfFr5aVIbzOjdxlJ9aZ2CQ1SicxV3VleVIT9XOasCRkBeSPwdPEUrCDUvTcJDSl89v9NVB0xtOls7A2GEnUx8NQAn8uXq2UUjCDbFii-wi1XCU9uJe7u4yUSWQzt4fjNcbcMLG98mSuols Jun 03 10:09:04.264358 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Id: None Jun 03 10:09:04.264358 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Name: None Jun 03 10:09:04.264358 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Identity-Status: Confirmed Jun 03 10:09:04.264358 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Is-Admin-Project: True Jun 03 10:09:04.264358 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Id: default Jun 03 10:09:04.264358 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Name: Default Jun 03 10:09:04.264358 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Id: 5476f21b29944eb69e32a2d97b328aed Jun 03 10:09:04.264358 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Name: tempest-TestVolumeBootPattern-70577832 Jun 03 10:09:04.264358 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Role: member,reader Jun 03 10:09:04.264358 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Roles: member,reader Jun 03 10:09:04.265763 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5476f21b29944eb69e32a2d97b328aed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5476f21b29944eb69e32a2d97b328aed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5476f21b29944eb69e32a2d97b328aed", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5476f21b29944eb69e32a2d97b328aed"}]}] Jun 03 10:09:04.265763 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant: tempest-TestVolumeBootPattern-70577832 Jun 03 10:09:04.265763 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Id: 5476f21b29944eb69e32a2d97b328aed Jun 03 10:09:04.265763 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Name: tempest-TestVolumeBootPattern-70577832 Jun 03 10:09:04.265763 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User: tempest-TestVolumeBootPattern-70577832-project Jun 03 10:09:04.265763 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Id: default Jun 03 10:09:04.265763 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Name: Default Jun 03 10:09:04.265763 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Id: 646fecf4405c41a0bc062c6b54fd311c Jun 03 10:09:04.265763 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Name: tempest-TestVolumeBootPattern-70577832-project Jun 03 10:09:04.265763 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: method: > Jun 03 10:09:04.265763 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: exception: Instance 7b4620df-63bb-4550-b854-4c81bb1219e0 could not be found. Jun 03 10:09:04.265763 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: action_args: {'id': '7b4620df-63bb-4550-b854-4c81bb1219e0'} Jun 03 10:09:04.266566 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:09:04.266566 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:09:04.266566 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:09:04.266566 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:09:04.266566 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:09:04.266566 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:09:04.266566 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:09:04.266566 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:09:04.266566 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:09:04.266566 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:09:04.266566 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b4620df-63bb-4550-b854-4c81bb1219e0 could not be found. Jun 03 10:09:04.266566 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:09:04.266566 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:09:04.266566 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:09:04.266566 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:09:04.266566 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:09:04.266566 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:09:04.266566 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:09:04.266566 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:09:04.266566 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:09:04.267824 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:09:04.267824 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:09:04.267824 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:09:04.267824 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:09:04.267824 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:09:04.267824 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:09:04.267824 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:09:04.267824 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b4620df-63bb-4550-b854-4c81bb1219e0 could not be found. Jun 03 10:09:04.267824 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:09:04.267824 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:09:04.267824 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:09:04.267824 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:09:04.267824 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:09:04.267824 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:09:04.267824 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:09:04.267824 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:09:04.267824 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b4620df-63bb-4550-b854-4c81bb1219e0 could not be found. Jun 03 10:09:04.267824 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:09:04.268931 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-f920bc63-b4ff-48cd-9d77-05a4e28f9a47 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Returning 404 to user: Instance 7b4620df-63bb-4550-b854-4c81bb1219e0 could not be found. {{(pid=125066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:09:04.268931 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-f920bc63-b4ff-48cd-9d77-05a4e28f9a47 tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0" status: 404 len: 111 microversion: 2.1 time: 0.033714 Jun 03 10:09:04.268931 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 538/1093] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:04 2022] GET /compute/v2.1/servers/7b4620df-63bb-4550-b854-4c81bb1219e0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:09:05.105141 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-771533d6-60da-4782-ab93-9b432bf2ebd5 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:05.105749 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-771533d6-60da-4782-ab93-9b432bf2ebd5 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:05.112481 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-771533d6-60da-4782-ab93-9b432bf2ebd5 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:05.112938 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-771533d6-60da-4782-ab93-9b432bf2ebd5 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:05.113723 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-771533d6-60da-4782-ab93-9b432bf2ebd5 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:05.114190 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-771533d6-60da-4782-ab93-9b432bf2ebd5 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:05.342609 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-771533d6-60da-4782-ab93-9b432bf2ebd5 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:09:05.351537 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-771533d6-60da-4782-ab93-9b432bf2ebd5 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1755 microversion: 2.1 time: 0.250660 Jun 03 10:09:05.352102 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 556/1094] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:05 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1755 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:09:05.799910 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-bb22d41b-4a08-4393-8687-7bc63cf2a5ed tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] Calling method '.version_select at 0x7f8d23cd3b80>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:05.887317 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-bb22d41b-4a08-4393-8687-7bc63cf2a5ed tempest-TestVolumeBootPattern-70577832 tempest-TestVolumeBootPattern-70577832-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1365846056" status: 202 len: 0 microversion: 2.1 time: 0.091365 Jun 03 10:09:05.887935 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 539/1095] 10.222.0.42 () {58 vars in 1262 bytes} [Fri Jun 3 10:09:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1365846056 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:09:06.373066 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-c8f014ba-3c03-4563-9102-7980daf52f68 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:06.373702 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-c8f014ba-3c03-4563-9102-7980daf52f68 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:06.382723 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c8f014ba-3c03-4563-9102-7980daf52f68 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:06.383182 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c8f014ba-3c03-4563-9102-7980daf52f68 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:06.383964 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c8f014ba-3c03-4563-9102-7980daf52f68 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:06.384414 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-c8f014ba-3c03-4563-9102-7980daf52f68 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:06.570820 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-c8f014ba-3c03-4563-9102-7980daf52f68 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:09:06.579538 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-c8f014ba-3c03-4563-9102-7980daf52f68 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1755 microversion: 2.1 time: 0.214828 Jun 03 10:09:06.589543 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 557/1096] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:06 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1755 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:09:07.597941 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-509cb63a-b739-40d5-8863-db084a7f0f88 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:07.599040 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-509cb63a-b739-40d5-8863-db084a7f0f88 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:07.607078 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-509cb63a-b739-40d5-8863-db084a7f0f88 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:07.607648 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-509cb63a-b739-40d5-8863-db084a7f0f88 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:07.608560 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-509cb63a-b739-40d5-8863-db084a7f0f88 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:07.609386 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-509cb63a-b739-40d5-8863-db084a7f0f88 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:07.916034 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-509cb63a-b739-40d5-8863-db084a7f0f88 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:09:07.924756 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-509cb63a-b739-40d5-8863-db084a7f0f88 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1755 microversion: 2.1 time: 0.331268 Jun 03 10:09:07.925348 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 540/1097] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:07 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1755 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:09:08.942438 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-5bd75bd8-f114-442a-ae5d-c87f1a3a2cc1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:08.943069 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-5bd75bd8-f114-442a-ae5d-c87f1a3a2cc1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:08.951490 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5bd75bd8-f114-442a-ae5d-c87f1a3a2cc1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:08.951948 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5bd75bd8-f114-442a-ae5d-c87f1a3a2cc1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:08.955888 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5bd75bd8-f114-442a-ae5d-c87f1a3a2cc1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:08.956347 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-5bd75bd8-f114-442a-ae5d-c87f1a3a2cc1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:09.135369 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-5bd75bd8-f114-442a-ae5d-c87f1a3a2cc1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:09:09.144940 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-5bd75bd8-f114-442a-ae5d-c87f1a3a2cc1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1755 microversion: 2.1 time: 0.207342 Jun 03 10:09:09.145626 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 558/1098] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:08 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1755 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:09:10.163406 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-f6ce80e1-2c10-457d-a6cb-f2832edacd90 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:10.164016 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-f6ce80e1-2c10-457d-a6cb-f2832edacd90 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:10.171511 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f6ce80e1-2c10-457d-a6cb-f2832edacd90 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:10.171957 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f6ce80e1-2c10-457d-a6cb-f2832edacd90 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:10.172719 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f6ce80e1-2c10-457d-a6cb-f2832edacd90 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:10.173339 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-f6ce80e1-2c10-457d-a6cb-f2832edacd90 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:10.322018 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-f6ce80e1-2c10-457d-a6cb-f2832edacd90 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:09:10.330212 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-f6ce80e1-2c10-457d-a6cb-f2832edacd90 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1755 microversion: 2.1 time: 0.171063 Jun 03 10:09:10.330795 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 541/1099] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:10 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:09:11.348715 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-7a44842a-1bde-4fc3-a6f5-ed8bf7c172bd tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:11.349871 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-7a44842a-1bde-4fc3-a6f5-ed8bf7c172bd tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:11.356511 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7a44842a-1bde-4fc3-a6f5-ed8bf7c172bd tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:11.356958 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7a44842a-1bde-4fc3-a6f5-ed8bf7c172bd tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:11.357722 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7a44842a-1bde-4fc3-a6f5-ed8bf7c172bd tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:11.358187 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-7a44842a-1bde-4fc3-a6f5-ed8bf7c172bd tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:11.510634 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-7a44842a-1bde-4fc3-a6f5-ed8bf7c172bd tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:09:11.524583 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-7a44842a-1bde-4fc3-a6f5-ed8bf7c172bd tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1755 microversion: 2.1 time: 0.176109 Jun 03 10:09:11.525318 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 559/1100] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:11 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:09:12.543582 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-d7bda1fc-cd58-4b9f-b5f1-3c0728e03f1d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:12.544185 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-d7bda1fc-cd58-4b9f-b5f1-3c0728e03f1d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:12.550624 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d7bda1fc-cd58-4b9f-b5f1-3c0728e03f1d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:12.551069 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d7bda1fc-cd58-4b9f-b5f1-3c0728e03f1d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:12.551829 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d7bda1fc-cd58-4b9f-b5f1-3c0728e03f1d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:12.552915 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-d7bda1fc-cd58-4b9f-b5f1-3c0728e03f1d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:12.702831 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-d7bda1fc-cd58-4b9f-b5f1-3c0728e03f1d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:09:12.721096 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-d7bda1fc-cd58-4b9f-b5f1-3c0728e03f1d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1755 microversion: 2.1 time: 0.171292 Jun 03 10:09:12.721096 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 542/1101] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:12 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:09:13.736621 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-2e8693d1-0709-4f79-8e49-c6192ebb1bf1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:13.737294 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-2e8693d1-0709-4f79-8e49-c6192ebb1bf1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:13.743918 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2e8693d1-0709-4f79-8e49-c6192ebb1bf1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:13.744372 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2e8693d1-0709-4f79-8e49-c6192ebb1bf1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:13.745164 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2e8693d1-0709-4f79-8e49-c6192ebb1bf1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:13.745599 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2e8693d1-0709-4f79-8e49-c6192ebb1bf1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:13.890741 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-2e8693d1-0709-4f79-8e49-c6192ebb1bf1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:09:13.899380 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-2e8693d1-0709-4f79-8e49-c6192ebb1bf1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1755 microversion: 2.1 time: 0.166694 Jun 03 10:09:13.899944 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 560/1102] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:13 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:09:14.917000 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-80c7e81f-e54a-407c-a8db-1f40c38cd7f1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:14.917714 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-80c7e81f-e54a-407c-a8db-1f40c38cd7f1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:14.920174 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:09:14.925312 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-80c7e81f-e54a-407c-a8db-1f40c38cd7f1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:14.925763 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-80c7e81f-e54a-407c-a8db-1f40c38cd7f1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:14.926619 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-80c7e81f-e54a-407c-a8db-1f40c38cd7f1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:14.927795 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-80c7e81f-e54a-407c-a8db-1f40c38cd7f1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:15.075798 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-80c7e81f-e54a-407c-a8db-1f40c38cd7f1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:09:15.084210 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-80c7e81f-e54a-407c-a8db-1f40c38cd7f1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1755 microversion: 2.1 time: 0.171848 Jun 03 10:09:15.084795 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 543/1103] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:14 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:09:16.101125 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-1d118eb9-a2a3-4c48-8ac3-222011d63430 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:16.101943 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-1d118eb9-a2a3-4c48-8ac3-222011d63430 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:16.104490 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:09:16.109909 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1d118eb9-a2a3-4c48-8ac3-222011d63430 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:16.110453 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1d118eb9-a2a3-4c48-8ac3-222011d63430 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:16.111242 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1d118eb9-a2a3-4c48-8ac3-222011d63430 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:16.112019 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1d118eb9-a2a3-4c48-8ac3-222011d63430 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:16.268960 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-1d118eb9-a2a3-4c48-8ac3-222011d63430 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:09:16.277032 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-1d118eb9-a2a3-4c48-8ac3-222011d63430 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1758 microversion: 2.1 time: 0.180106 Jun 03 10:09:16.277596 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 561/1104] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:16 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:09:48.669501 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-e141b3d5-d83e-4a72-96cf-200d8f67d243 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1951292509"}} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:09:48.670193 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-e141b3d5-d83e-4a72-96cf-200d8f67d243 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:48.672168 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG dbcounter [-] [125066] Writing DB stats nova_cell1:SELECT=31 {{(pid=125066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:09:48.676955 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e141b3d5-d83e-4a72-96cf-200d8f67d243 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:48.677396 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e141b3d5-d83e-4a72-96cf-200d8f67d243 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:48.678165 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e141b3d5-d83e-4a72-96cf-200d8f67d243 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:48.678600 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e141b3d5-d83e-4a72-96cf-200d8f67d243 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:48.808212 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.network.security_group_api [None req-e141b3d5-d83e-4a72-96cf-200d8f67d243 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Removing security group cef61ad8-b587-47c5-8346-035aa684925d from port 9712d570-b0e3-4cae-821e-95248d924048 Jun 03 10:09:49.260652 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-e141b3d5-d83e-4a72-96cf-200d8f67d243 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "POST /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9/action" status: 202 len: 0 microversion: 2.1 time: 0.595268 Jun 03 10:09:49.261605 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 544/1105] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Jun 3 10:09:48 2022] POST /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9/action => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:09:49.282116 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-1e5f9356-bb21-42d0-9749-b551de330b71 req-e683230c-7e43-4bc0-8372-d589676c8cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f97c1a06-6edf-4ccd-84b1-9f0cf52788f9", "tag": "9712d570-b0e3-4cae-821e-95248d924048"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:09:49.286735 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG dbcounter [-] [125065] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:09:49.297999 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-1e5f9356-bb21-42d0-9749-b551de330b71 req-e683230c-7e43-4bc0-8372-d589676c8cc5 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:49.298815 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-1e5f9356-bb21-42d0-9749-b551de330b71 req-e683230c-7e43-4bc0-8372-d589676c8cc5 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:49.311632 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-1e5f9356-bb21-42d0-9749-b551de330b71 req-e683230c-7e43-4bc0-8372-d589676c8cc5 service nova] Creating event network-changed:9712d570-b0e3-4cae-821e-95248d924048 for instance f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 on hv-cinder-84456 Jun 03 10:09:49.319788 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-1e5f9356-bb21-42d0-9749-b551de330b71 req-e683230c-7e43-4bc0-8372-d589676c8cc5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041340 Jun 03 10:09:49.322387 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 562/1106] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:09:50.577722 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [req-dbd0636d-61ad-49d6-be96-bd447178abaa req-087fb833-fd66-41fa-bb55-d0681c9be955 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f97c1a06-6edf-4ccd-84b1-9f0cf52788f9", "tag": "9712d570-b0e3-4cae-821e-95248d924048"}]} {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:09:50.589654 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-5c326d1e-bcbb-4cdc-8c09-bc0fbac4f8ed tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:50.590204 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-5c326d1e-bcbb-4cdc-8c09-bc0fbac4f8ed tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:50.595220 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-dbd0636d-61ad-49d6-be96-bd447178abaa req-087fb833-fd66-41fa-bb55-d0681c9be955 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:50.599542 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [req-dbd0636d-61ad-49d6-be96-bd447178abaa req-087fb833-fd66-41fa-bb55-d0681c9be955 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:50.599680 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5c326d1e-bcbb-4cdc-8c09-bc0fbac4f8ed tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:50.599680 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5c326d1e-bcbb-4cdc-8c09-bc0fbac4f8ed tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:50.599680 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5c326d1e-bcbb-4cdc-8c09-bc0fbac4f8ed tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:50.599680 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-5c326d1e-bcbb-4cdc-8c09-bc0fbac4f8ed tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:50.608034 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.compute.server_external_events [req-dbd0636d-61ad-49d6-be96-bd447178abaa req-087fb833-fd66-41fa-bb55-d0681c9be955 service nova] Creating event network-changed:9712d570-b0e3-4cae-821e-95248d924048 for instance f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 on hv-cinder-84456 Jun 03 10:09:50.612896 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [req-dbd0636d-61ad-49d6-be96-bd447178abaa req-087fb833-fd66-41fa-bb55-d0681c9be955 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038993 Jun 03 10:09:50.614031 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 563/1107] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:09:50.690467 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.objects.instance [None req-5c326d1e-bcbb-4cdc-8c09-bc0fbac4f8ed tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lazy-loading 'services' on Instance uuid f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 {{(pid=125066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:09:50.972001 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-5c326d1e-bcbb-4cdc-8c09-bc0fbac4f8ed tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9/os-volume_attachments/c2cec5a4-4d95-40ad-9cea-0d4eae210652" status: 202 len: 0 microversion: 2.1 time: 0.400954 Jun 03 10:09:50.972792 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 545/1108] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jun 3 10:09:50 2022] DELETE /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9/os-volume_attachments/c2cec5a4-4d95-40ad-9cea-0d4eae210652 => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:09:50.985172 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-1f285567-1072-4575-a954-fa0a8a9ab3e6 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:50.986777 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-1f285567-1072-4575-a954-fa0a8a9ab3e6 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:50.996416 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1f285567-1072-4575-a954-fa0a8a9ab3e6 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:50.996878 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1f285567-1072-4575-a954-fa0a8a9ab3e6 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:50.997727 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1f285567-1072-4575-a954-fa0a8a9ab3e6 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:50.998208 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-1f285567-1072-4575-a954-fa0a8a9ab3e6 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:51.029314 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-1f285567-1072-4575-a954-fa0a8a9ab3e6 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051346 Jun 03 10:09:51.030271 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 564/1109] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 3 10:09:50 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:09:52.042738 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-b5ebd9c9-aaf8-44cc-9548-ded997af8368 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:52.043804 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-b5ebd9c9-aaf8-44cc-9548-ded997af8368 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:52.051591 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b5ebd9c9-aaf8-44cc-9548-ded997af8368 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:52.052630 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b5ebd9c9-aaf8-44cc-9548-ded997af8368 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:52.052785 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b5ebd9c9-aaf8-44cc-9548-ded997af8368 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:52.053344 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-b5ebd9c9-aaf8-44cc-9548-ded997af8368 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:52.084683 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-b5ebd9c9-aaf8-44cc-9548-ded997af8368 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047035 Jun 03 10:09:52.085235 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 546/1110] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 3 10:09:52 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:09:53.096968 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-0650f84c-14b3-49a3-a73b-3b5aef284ed9 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:53.097871 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-0650f84c-14b3-49a3-a73b-3b5aef284ed9 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:53.104915 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0650f84c-14b3-49a3-a73b-3b5aef284ed9 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:53.105353 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0650f84c-14b3-49a3-a73b-3b5aef284ed9 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:53.106135 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0650f84c-14b3-49a3-a73b-3b5aef284ed9 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:53.106565 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-0650f84c-14b3-49a3-a73b-3b5aef284ed9 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:53.133810 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-0650f84c-14b3-49a3-a73b-3b5aef284ed9 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040852 Jun 03 10:09:53.134380 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 565/1111] 10.222.0.42 () {58 vars in 1301 bytes} [Fri Jun 3 10:09:53 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 10:09:53.144739 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-e4bcf016-4984-445f-847b-de73bfe3a00d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:53.145232 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-e4bcf016-4984-445f-847b-de73bfe3a00d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:53.152437 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e4bcf016-4984-445f-847b-de73bfe3a00d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:53.152886 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e4bcf016-4984-445f-847b-de73bfe3a00d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:53.153648 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e4bcf016-4984-445f-847b-de73bfe3a00d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:53.154117 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-e4bcf016-4984-445f-847b-de73bfe3a00d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:53.227887 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.wsgi [None req-e4bcf016-4984-445f-847b-de73bfe3a00d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] HTTP exception thrown: Instance f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 is not attached to volume c2cec5a4-4d95-40ad-9cea-0d4eae210652 Jun 03 10:09:53.237177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-e4bcf016-4984-445f-847b-de73bfe3a00d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Request method failure captured: Jun 03 10:09:53.237177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: request: DELETE /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9/os-volume_attachments/c2cec5a4-4d95-40ad-9cea-0d4eae210652 HTTP/1.1 Jun 03 10:09:53.237177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept: application/json Jun 03 10:09:53.237177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept-Encoding: identity Jun 03 10:09:53.237177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Connection: close Jun 03 10:09:53.237177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Length: 0 Jun 03 10:09:53.237177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Type: application/json Jun 03 10:09:53.237177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Host: 10.222.0.42 Jun 03 10:09:53.237177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Openstack-System-Scope: None Jun 03 10:09:53.237177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: User-Agent: python-urllib3/1.26.9 Jun 03 10:09:53.237177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Auth-Token: gAAAAABimd11kdN-l5bTbpyaRDerX9wRGFJDrz52Eb14WNORJrwixH00-HcMmibnqGID0xOgNeh5YZjb-g2qZv6s0Ec22j-gXtlfcw2nuTV-gfJsIXNnWXaVnvr84WHpmnxYKjPeSNBY84B38W_2NgNM33IXZewG4R0XvanHu2eLz1QpCwfiIlg Jun 03 10:09:53.237177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Id: None Jun 03 10:09:53.237177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Name: None Jun 03 10:09:53.237177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Identity-Status: Confirmed Jun 03 10:09:53.237177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Is-Admin-Project: True Jun 03 10:09:53.237177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Id: default Jun 03 10:09:53.237177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Name: Default Jun 03 10:09:53.237177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Id: bc1aca15157e45bf95284345dcabf101 Jun 03 10:09:53.237177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Name: tempest-TestMinimumBasicScenario-2133250851 Jun 03 10:09:53.237177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Role: member,reader Jun 03 10:09:53.237177 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Roles: member,reader Jun 03 10:09:53.238946 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bc1aca15157e45bf95284345dcabf101"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc1aca15157e45bf95284345dcabf101"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bc1aca15157e45bf95284345dcabf101", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc1aca15157e45bf95284345dcabf101"}]}] Jun 03 10:09:53.238946 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant: tempest-TestMinimumBasicScenario-2133250851 Jun 03 10:09:53.238946 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Id: bc1aca15157e45bf95284345dcabf101 Jun 03 10:09:53.238946 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2133250851 Jun 03 10:09:53.238946 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User: tempest-TestMinimumBasicScenario-2133250851-project Jun 03 10:09:53.238946 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Id: default Jun 03 10:09:53.238946 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Name: Default Jun 03 10:09:53.238946 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Id: 0b94fa871aee4c35851e6e939838d2f6 Jun 03 10:09:53.238946 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Name: tempest-TestMinimumBasicScenario-2133250851-project Jun 03 10:09:53.238946 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: method: > Jun 03 10:09:53.238946 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: exception: Instance f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 is not attached to volume c2cec5a4-4d95-40ad-9cea-0d4eae210652 Jun 03 10:09:53.239890 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: action_args: {'server_id': 'f97c1a06-6edf-4ccd-84b1-9f0cf52788f9', 'id': 'c2cec5a4-4d95-40ad-9cea-0d4eae210652'} Jun 03 10:09:53.239890 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:09:53.239890 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:09:53.239890 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 03 10:09:53.239890 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 03 10:09:53.239890 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 10:09:53.239890 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 10:09:53.239890 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 03 10:09:53.239890 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 03 10:09:53.239890 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c2cec5a4-4d95-40ad-9cea-0d4eae210652. Jun 03 10:09:53.239890 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:09:53.239890 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:09:53.239890 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:09:53.239890 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:09:53.239890 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:09:53.239890 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:09:53.239890 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:09:53.239890 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:09:53.239890 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:09:53.241470 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:09:53.241470 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 03 10:09:53.241470 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 03 10:09:53.241470 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 is not attached to volume c2cec5a4-4d95-40ad-9cea-0d4eae210652 Jun 03 10:09:53.241470 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:09:53.241470 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:09:53.241470 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:09:53.241470 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:09:53.241470 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:09:53.241470 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:09:53.241470 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:09:53.241470 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:09:53.241470 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 is not attached to volume c2cec5a4-4d95-40ad-9cea-0d4eae210652 Jun 03 10:09:53.241470 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:09:53.241470 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-e4bcf016-4984-445f-847b-de73bfe3a00d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Returning 404 to user: Instance f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 is not attached to volume c2cec5a4-4d95-40ad-9cea-0d4eae210652 {{(pid=125066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:09:53.242662 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-e4bcf016-4984-445f-847b-de73bfe3a00d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9/os-volume_attachments/c2cec5a4-4d95-40ad-9cea-0d4eae210652" status: 404 len: 154 microversion: 2.1 time: 0.097917 Jun 03 10:09:53.242662 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 547/1112] 10.222.0.42 () {58 vars in 1415 bytes} [Fri Jun 3 10:09:53 2022] DELETE /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9/os-volume_attachments/c2cec5a4-4d95-40ad-9cea-0d4eae210652 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 10:09:54.559466 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-fc6c9728-bab9-4c34-b177-6a05a21e1468 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:54.559960 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-fc6c9728-bab9-4c34-b177-6a05a21e1468 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:54.566347 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-fc6c9728-bab9-4c34-b177-6a05a21e1468 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:54.566790 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-fc6c9728-bab9-4c34-b177-6a05a21e1468 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:54.567573 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-fc6c9728-bab9-4c34-b177-6a05a21e1468 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:54.568004 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-fc6c9728-bab9-4c34-b177-6a05a21e1468 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:54.593374 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-fc6c9728-bab9-4c34-b177-6a05a21e1468 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Going to try to terminate instance {{(pid=125065) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:09:54.919973 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-fc6c9728-bab9-4c34-b177-6a05a21e1468 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 204 len: 0 microversion: 2.1 time: 0.363979 Jun 03 10:09:54.920554 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 566/1113] 10.222.0.42 () {58 vars in 1238 bytes} [Fri Jun 3 10:09:54 2022] DELETE /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:09:54.928576 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-229f4ee2-7a19-4c78-8c62-ba677f4a5b82 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:54.929184 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-229f4ee2-7a19-4c78-8c62-ba677f4a5b82 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:54.935697 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-229f4ee2-7a19-4c78-8c62-ba677f4a5b82 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:54.936142 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-229f4ee2-7a19-4c78-8c62-ba677f4a5b82 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:54.936890 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-229f4ee2-7a19-4c78-8c62-ba677f4a5b82 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:54.937320 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-229f4ee2-7a19-4c78-8c62-ba677f4a5b82 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:55.064752 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.policy [None req-229f4ee2-7a19-4c78-8c62-ba677f4a5b82 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125066) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:09:55.072227 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-229f4ee2-7a19-4c78-8c62-ba677f4a5b82 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1553 microversion: 2.1 time: 0.147428 Jun 03 10:09:55.072879 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 548/1114] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:54 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:09:56.096551 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-95d148c6-c7d5-46b0-bd2d-6d51171b33e1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:56.097260 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-95d148c6-c7d5-46b0-bd2d-6d51171b33e1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:56.103834 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-95d148c6-c7d5-46b0-bd2d-6d51171b33e1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:56.104301 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-95d148c6-c7d5-46b0-bd2d-6d51171b33e1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:56.105090 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-95d148c6-c7d5-46b0-bd2d-6d51171b33e1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:56.105525 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-95d148c6-c7d5-46b0-bd2d-6d51171b33e1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:56.238898 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-95d148c6-c7d5-46b0-bd2d-6d51171b33e1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:09:56.246402 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-95d148c6-c7d5-46b0-bd2d-6d51171b33e1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1553 microversion: 2.1 time: 0.154162 Jun 03 10:09:56.246973 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 567/1115] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:56 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:09:57.150125 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [req-1e53ee50-5286-401a-abf9-9ca3069b22e4 req-ccfc1db3-a852-4c1c-9ea0-15871233c7f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f97c1a06-6edf-4ccd-84b1-9f0cf52788f9", "name": "network-vif-deleted", "tag": "9712d570-b0e3-4cae-821e-95248d924048"}]} {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:09:57.159441 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-1e53ee50-5286-401a-abf9-9ca3069b22e4 req-ccfc1db3-a852-4c1c-9ea0-15871233c7f2 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:57.159884 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [req-1e53ee50-5286-401a-abf9-9ca3069b22e4 req-ccfc1db3-a852-4c1c-9ea0-15871233c7f2 service nova] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:57.170743 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.compute.server_external_events [req-1e53ee50-5286-401a-abf9-9ca3069b22e4 req-ccfc1db3-a852-4c1c-9ea0-15871233c7f2 service nova] Creating event network-vif-deleted:9712d570-b0e3-4cae-821e-95248d924048 for instance f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 on hv-cinder-84456 Jun 03 10:09:57.175619 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [req-1e53ee50-5286-401a-abf9-9ca3069b22e4 req-ccfc1db3-a852-4c1c-9ea0-15871233c7f2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029218 Jun 03 10:09:57.176193 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 549/1116] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Jun 3 10:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:09:57.264362 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-2e91a99c-2436-4eb2-8cd4-32488bfe109d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:57.264973 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.compute.api [None req-2e91a99c-2436-4eb2-8cd4-32488bfe109d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125065) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:57.272067 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2e91a99c-2436-4eb2-8cd4-32488bfe109d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:57.275319 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2e91a99c-2436-4eb2-8cd4-32488bfe109d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:57.275319 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2e91a99c-2436-4eb2-8cd4-32488bfe109d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:57.275319 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG oslo_concurrency.lockutils [None req-2e91a99c-2436-4eb2-8cd4-32488bfe109d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:57.339736 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.policy [None req-2e91a99c-2436-4eb2-8cd4-32488bfe109d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b94fa871aee4c35851e6e939838d2f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc1aca15157e45bf95284345dcabf101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125065) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:09:57.347386 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-2e91a99c-2436-4eb2-8cd4-32488bfe109d tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 200 len: 1343 microversion: 2.1 time: 0.087794 Jun 03 10:09:57.347945 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 568/1117] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:57 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 1343 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:09:58.364450 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-10f55cc1-7c6c-4b75-bf90-83c9ff75cfc5 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '>' {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:58.365148 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.compute.api [None req-10f55cc1-7c6c-4b75-bf90-83c9ff75cfc5 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] [instance: f97c1a06-6edf-4ccd-84b1-9f0cf52788f9] Fetching instance by UUID {{(pid=125066) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:58.371589 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-10f55cc1-7c6c-4b75-bf90-83c9ff75cfc5 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:58.372045 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-10f55cc1-7c6c-4b75-bf90-83c9ff75cfc5 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:58.372892 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-10f55cc1-7c6c-4b75-bf90-83c9ff75cfc5 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:58.373333 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG oslo_concurrency.lockutils [None req-10f55cc1-7c6c-4b75-bf90-83c9ff75cfc5 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Lock "17431b75-2fed-4946-b465-0bb5f71f4e56" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:58.388105 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.wsgi [None req-10f55cc1-7c6c-4b75-bf90-83c9ff75cfc5 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] HTTP exception thrown: Instance f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 could not be found. Jun 03 10:09:58.389744 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-10f55cc1-7c6c-4b75-bf90-83c9ff75cfc5 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Request method failure captured: Jun 03 10:09:58.389744 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: request: GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 HTTP/1.1 Jun 03 10:09:58.389744 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept: application/json Jun 03 10:09:58.389744 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Accept-Encoding: identity Jun 03 10:09:58.389744 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Connection: close Jun 03 10:09:58.389744 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Length: 0 Jun 03 10:09:58.389744 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Content-Type: application/json Jun 03 10:09:58.389744 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Host: 10.222.0.42 Jun 03 10:09:58.389744 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Openstack-System-Scope: None Jun 03 10:09:58.389744 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: User-Agent: python-urllib3/1.26.9 Jun 03 10:09:58.389744 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Auth-Token: gAAAAABimd11kdN-l5bTbpyaRDerX9wRGFJDrz52Eb14WNORJrwixH00-HcMmibnqGID0xOgNeh5YZjb-g2qZv6s0Ec22j-gXtlfcw2nuTV-gfJsIXNnWXaVnvr84WHpmnxYKjPeSNBY84B38W_2NgNM33IXZewG4R0XvanHu2eLz1QpCwfiIlg Jun 03 10:09:58.389744 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Id: None Jun 03 10:09:58.389744 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Domain-Name: None Jun 03 10:09:58.389744 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Identity-Status: Confirmed Jun 03 10:09:58.389744 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Is-Admin-Project: True Jun 03 10:09:58.389744 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Id: default Jun 03 10:09:58.389744 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Domain-Name: Default Jun 03 10:09:58.389744 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Id: bc1aca15157e45bf95284345dcabf101 Jun 03 10:09:58.389744 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Project-Name: tempest-TestMinimumBasicScenario-2133250851 Jun 03 10:09:58.389744 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Role: member,reader Jun 03 10:09:58.389744 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Roles: member,reader Jun 03 10:09:58.391397 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bc1aca15157e45bf95284345dcabf101"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc1aca15157e45bf95284345dcabf101"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bc1aca15157e45bf95284345dcabf101", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc1aca15157e45bf95284345dcabf101"}]}] Jun 03 10:09:58.391397 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant: tempest-TestMinimumBasicScenario-2133250851 Jun 03 10:09:58.391397 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Id: bc1aca15157e45bf95284345dcabf101 Jun 03 10:09:58.391397 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2133250851 Jun 03 10:09:58.391397 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User: tempest-TestMinimumBasicScenario-2133250851-project Jun 03 10:09:58.391397 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Id: default Jun 03 10:09:58.391397 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Domain-Name: Default Jun 03 10:09:58.391397 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Id: 0b94fa871aee4c35851e6e939838d2f6 Jun 03 10:09:58.391397 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: X-User-Name: tempest-TestMinimumBasicScenario-2133250851-project Jun 03 10:09:58.391397 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: method: > Jun 03 10:09:58.391397 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: exception: Instance f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 could not be found. Jun 03 10:09:58.391397 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: action_args: {'id': 'f97c1a06-6edf-4ccd-84b1-9f0cf52788f9'} Jun 03 10:09:58.392258 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: {{(pid=125066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:09:58.392258 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:09:58.392258 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:09:58.392258 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:09:58.392258 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:09:58.392258 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:09:58.392258 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:09:58.392258 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:09:58.392258 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:09:58.392258 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:09:58.392258 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 could not be found. Jun 03 10:09:58.392258 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:09:58.392258 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:09:58.392258 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:09:58.392258 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:09:58.392258 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:09:58.392258 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:09:58.392258 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:09:58.392258 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:09:58.392258 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:09:58.393517 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:09:58.393517 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:09:58.393517 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:09:58.393517 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:09:58.393517 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:09:58.393517 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:09:58.393517 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:09:58.393517 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 could not be found. Jun 03 10:09:58.393517 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:09:58.393517 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:09:58.393517 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:09:58.393517 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:09:58.393517 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:09:58.393517 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:09:58.393517 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:09:58.393517 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:09:58.393517 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 could not be found. Jun 03 10:09:58.393517 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: ERROR nova.api.openstack.wsgi Jun 03 10:09:58.394812 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: DEBUG nova.api.openstack.wsgi [None req-10f55cc1-7c6c-4b75-bf90-83c9ff75cfc5 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Returning 404 to user: Instance f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 could not be found. {{(pid=125066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:09:58.394812 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO nova.api.openstack.requestlog [None req-10f55cc1-7c6c-4b75-bf90-83c9ff75cfc5 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9" status: 404 len: 111 microversion: 2.1 time: 0.031562 Jun 03 10:09:58.394812 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: [pid: 125066|app: 0|req: 550/1118] 10.222.0.42 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:58 2022] GET /compute/v2.1/servers/f97c1a06-6edf-4ccd-84b1-9f0cf52788f9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 10:09:58.399717 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: DEBUG nova.api.openstack.wsgi [None req-c160cdf6-c0fc-4054-aca9-6ecd056075e1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] Calling method '.version_select at 0x7f8d23745280>' {{(pid=125065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:58.468858 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO nova.api.openstack.requestlog [None req-c160cdf6-c0fc-4054-aca9-6ecd056075e1 tempest-TestMinimumBasicScenario-2133250851 tempest-TestMinimumBasicScenario-2133250851-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-720580462" status: 202 len: 0 microversion: 2.1 time: 0.072901 Jun 03 10:09:58.469428 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: [pid: 125065|app: 0|req: 569/1119] 10.222.0.42 () {58 vars in 1268 bytes} [Fri Jun 3 10:09:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-720580462 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:11:47.271556 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 10:11:47.272171 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Fri Jun 3 10:11:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 10:13:16.138755 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 10:13:16.139421 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Fri Jun 3 10:13:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 10:13:28.502587 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 10:13:28.503187 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Fri Jun 3 10:13:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 10:15:07.280045 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 10:15:07.280648 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Fri Jun 3 10:15:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 10:15:09.555483 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 10:15:09.556092 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Fri Jun 3 10:15:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 10:15:12.630995 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 10:15:12.631648 dv-cinder-844563-1-iscsi devstack@n-api.service[125065]: Fri Jun 3 10:15:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 10:15:20.412267 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 10:15:20.412876 dv-cinder-844563-1-iscsi devstack@n-api.service[125066]: Fri Jun 3 10:15:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!